Aug 15 01:56:04 user nova-compute[73121]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 15 01:56:06 user nova-compute[73121]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73121) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 01:56:06 user nova-compute[73121]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73121) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 01:56:06 user nova-compute[73121]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73121) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 01:56:06 user nova-compute[73121]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 01:56:07 user nova-compute[73121]: INFO nova.virt.driver [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 15 01:56:07 user nova-compute[73121]: INFO nova.compute.provider_config [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] Acquiring lock "singleton_lock" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] Acquired lock "singleton_lock" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] Releasing lock "singleton_lock" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] Full set of CONF: {{(pid=73121) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ******************************************************************************** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] Configuration options gathered from: {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ================================================================================ {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] allow_resize_to_same_host      = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] arq_binding_timeout            = 300 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] backdoor_port                  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] backdoor_socket                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] block_device_allocate_retries  = 300 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] block_device_allocate_retries_interval = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cert                           = self.pem {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute_monitors               = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] config_dir                     = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] config_drive_format            = iso9660 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] config_source                  = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] console_host                   = user {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] control_exchange               = nova {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cpu_allocation_ratio           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] daemon                         = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] debug                          = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] default_access_ip_network_name = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] default_availability_zone      = nova {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] default_ephemeral_format       = ext4 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] default_schedule_zone          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] disk_allocation_ratio          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] enable_new_services            = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] enabled_ssl_apis               = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] flat_injected                  = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] force_config_drive             = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] force_raw_images               = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] graceful_shutdown_timeout      = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] heal_instance_info_cache_interval = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] host                           = user {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] instance_build_timeout         = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] instance_delete_interval       = 300 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] instance_name_template         = instance-%08x {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] instance_usage_audit           = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] instance_usage_audit_period    = month {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] internal_service_availability_zone = internal {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] key                            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] live_migration_retry_count     = 30 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] log_config_append              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] log_dir                        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] log_file                       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] log_options                    = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] log_rotate_interval            = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] log_rotate_interval_type       = days {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] log_rotation_type              = none {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] long_rpc_timeout               = 1800 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] max_concurrent_builds          = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] max_concurrent_live_migrations = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] max_concurrent_snapshots       = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] max_local_block_devices        = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] max_logfile_count              = 30 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] max_logfile_size_mb            = 200 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] maximum_instance_delete_attempts = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] metadata_listen                = 0.0.0.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] metadata_listen_port           = 8775 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] metadata_workers               = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] migrate_max_retries            = -1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] mkisofs_cmd                    = genisoimage {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] my_ip                          = 10.0.0.210 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] network_allocate_retries       = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] osapi_compute_listen_port      = 8774 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] osapi_compute_unique_server_name_scope =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] osapi_compute_workers          = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] password_length                = 12 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] periodic_enable                = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] periodic_fuzzy_delay           = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] pointer_model                  = ps2mouse {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] preallocate_images             = none {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] publish_errors                 = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] pybasedir                      = /opt/stack/nova {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ram_allocation_ratio           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] rate_limit_burst               = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] rate_limit_except_level        = CRITICAL {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] rate_limit_interval            = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] reboot_timeout                 = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] reclaim_instance_interval      = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] record                         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] reimage_timeout_per_gb         = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] report_interval                = 120 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] rescue_timeout                 = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] reserved_host_cpus             = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] reserved_host_disk_mb          = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] reserved_host_memory_mb        = 512 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] reserved_huge_pages            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] resize_confirm_window          = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] resize_fs_using_block_device   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] resume_guests_state_on_host_boot = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] rpc_response_timeout           = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] run_external_periodic_tasks    = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] running_deleted_instance_action = reap {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] running_deleted_instance_timeout = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler_instance_sync_interval = 120 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_down_time              = 720 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] servicegroup_driver            = db {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] shelved_offload_time           = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] shelved_poll_interval          = 3600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] shutdown_timeout               = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] source_is_ipv6                 = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ssl_only                       = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] state_path                     = /opt/stack/data/nova {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] sync_power_state_interval      = 600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] sync_power_state_pool_size     = 1000 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] syslog_log_facility            = LOG_USER {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] tempdir                        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] timeout_nbd                    = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] transport_url                  = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] update_resources_interval      = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] use_cow_images                 = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] use_eventlog                   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] use_journal                    = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] use_json                       = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] use_rootwrap_daemon            = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] use_stderr                     = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] use_syslog                     = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vcpu_pin_set                   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plugging_is_fatal          = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plugging_timeout           = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] virt_mkfs                      = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] volume_usage_poll_interval     = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] watch_log_file                 = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] web                            = /usr/share/spice-html5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_concurrency.disable_process_locking = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.auth_strategy              = keystone {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.compute_link_prefix        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.dhcp_domain                = novalocal {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.enable_instance_password   = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.glance_link_prefix         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.instance_list_per_project_cells = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.list_records_by_skipping_down_cells = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.local_metadata_per_cell    = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.max_limit                  = 1000 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.metadata_cache_expiration  = 15 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.neutron_default_tenant_id  = default {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.use_forwarded_for          = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.use_neutron_default_nets   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.vendordata_dynamic_targets = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.vendordata_jsonfile_path   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.backend_argument         = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.config_prefix            = cache.oslo {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.dead_timeout             = 60.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.debug_cache_backend      = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.enable_retry_client      = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.enable_socket_keepalive  = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.enabled                  = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.expiration_time          = 600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.hashclient_retry_attempts = 2 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_dead_retry      = 300 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_password        =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_sasl_enabled    = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.memcache_username        =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.proxies                  = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.retry_attempts           = 2 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.retry_delay              = 0.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.socket_keepalive_count   = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.socket_keepalive_idle    = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.socket_keepalive_interval = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.tls_allowed_ciphers      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.tls_cafile               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.tls_certfile             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.tls_enabled              = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cache.tls_keyfile              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.auth_section            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.auth_type               = password {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.cafile                  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.certfile                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.collect_timing          = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.cross_az_attach         = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.debug                   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.endpoint_template       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.http_retries            = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.insecure                = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.keyfile                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.os_region_name          = RegionOne {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.split_loggers           = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cinder.timeout                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.cpu_dedicated_set      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.cpu_shared_set         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.image_type_exclude_list = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.resource_provider_association_refresh = 300 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.shutdown_retry_interval = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] conductor.workers              = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] console.allowed_origins        = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] console.ssl_ciphers            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] console.ssl_minimum_version    = default {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] consoleauth.token_ttl          = 600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.cafile                  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.certfile                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.collect_timing          = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.connect_retries         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.connect_retry_delay     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.endpoint_override       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.insecure                = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.keyfile                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.max_version             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.min_version             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.region_name             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.service_name            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.service_type            = accelerator {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.split_loggers           = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.status_code_retries     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.status_code_retry_delay = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.timeout                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] cyborg.version                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.backend               = sqlalchemy {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.connection            = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.connection_debug      = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.connection_parameters =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.connection_recycle_time = 3600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.connection_trace      = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.db_inc_retry_interval = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.db_max_retries        = 20 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.db_max_retry_interval = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.db_retry_interval     = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.max_overflow          = 50 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.max_pool_size         = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.max_retries           = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.mysql_enable_ndb      = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.mysql_wsrep_sync_wait = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.pool_timeout          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.retry_interval        = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.slave_connection      = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] database.sqlite_synchronous    = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.backend           = sqlalchemy {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.connection        = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.connection_debug  = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.connection_parameters =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.connection_recycle_time = 3600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.connection_trace  = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.db_inc_retry_interval = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.db_max_retries    = 20 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.db_max_retry_interval = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.db_retry_interval = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.max_overflow      = 50 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.max_pool_size     = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.max_retries       = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.mysql_enable_ndb  = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.pool_timeout      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.retry_interval    = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.slave_connection  = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] api_database.sqlite_synchronous = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] devices.enabled_mdev_types     = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ephemeral_storage_encryption.enabled = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.api_servers             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.cafile                  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.certfile                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.collect_timing          = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.connect_retries         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.connect_retry_delay     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.debug                   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.default_trusted_certificate_ids = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.enable_certificate_validation = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.enable_rbd_download     = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.endpoint_override       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.insecure                = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.keyfile                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.max_version             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.min_version             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.num_retries             = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.rbd_ceph_conf           =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.rbd_connect_timeout     = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.rbd_pool                =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.rbd_user                =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.region_name             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.service_name            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.service_type            = image {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.split_loggers           = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.status_code_retries     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.status_code_retry_delay = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.timeout                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.verify_glance_signatures = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] glance.version                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] guestfs.debug                  = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.config_drive_cdrom      = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.config_drive_inject_password = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.enable_remotefx         = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.instances_path_share    =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.limit_cpu_features      = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.use_multipath_io        = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.vswitch_name            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] mks.enabled                    = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] image_cache.manager_interval   = 2400 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] image_cache.precache_concurrency = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] image_cache.remove_unused_base_images = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] image_cache.subdirectory_name  = _base {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.api_max_retries         = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.api_retry_interval      = 2 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.auth_section            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.auth_type               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.cafile                  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.certfile                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.collect_timing          = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.connect_retries         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.connect_retry_delay     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.endpoint_override       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.insecure                = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.keyfile                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.max_version             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.min_version             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.partition_key           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.peer_list               = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.region_name             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.serial_console_state_timeout = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.service_name            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.service_type            = baremetal {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.split_loggers           = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.status_code_retries     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.status_code_retry_delay = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.timeout                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ironic.version                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] key_manager.fixed_key          = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.barbican_api_version  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.barbican_endpoint     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.barbican_endpoint_type = public {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.barbican_region_name  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.cafile                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.certfile              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.collect_timing        = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.insecure              = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.keyfile               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.number_of_retries     = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.retry_delay           = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.send_service_user_token = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.split_loggers         = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.timeout               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.verify_ssl            = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican.verify_ssl_path       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican_service_user.auth_section = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican_service_user.auth_type = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican_service_user.cafile   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican_service_user.certfile = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican_service_user.collect_timing = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican_service_user.insecure = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican_service_user.keyfile  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican_service_user.split_loggers = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] barbican_service_user.timeout  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.approle_role_id          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.approle_secret_id        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.cafile                   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.certfile                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.collect_timing           = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.insecure                 = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.keyfile                  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.kv_mountpoint            = secret {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.kv_version               = 2 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.namespace                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.root_token_id            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.split_loggers            = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.ssl_ca_crt_file          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.timeout                  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.use_ssl                  = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.cafile                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.certfile              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.collect_timing        = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.connect_retries       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.connect_retry_delay   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.endpoint_override     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.insecure              = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.keyfile               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.max_version           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.min_version           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.region_name           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.service_name          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.service_type          = identity {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.split_loggers         = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.status_code_retries   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.status_code_retry_delay = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.timeout               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] keystone.version               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.connection_uri         =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.cpu_mode               = custom {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: WARNING oslo_config.cfg [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.cpu_power_governor_high = performance {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.cpu_power_management   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.device_detach_attempts = 8 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.device_detach_timeout  = 20 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.disk_cachemodes        = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.disk_prefix            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.enabled_perf_events    = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.file_backed_memory     = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.gid_maps               = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.hw_disk_discard        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.hw_machine_type        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.images_rbd_pool        = rbd {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.images_type            = default {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.images_volume_group    = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.inject_key             = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.inject_partition       = -2 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.inject_password        = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.iscsi_iface            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.iser_use_multipath     = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_downtime = 500 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_inbound_addr = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_scheme  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_timeout_action = abort {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_tunnelled = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: WARNING oslo_config.cfg [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 15 01:56:07 user nova-compute[73121]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 15 01:56:07 user nova-compute[73121]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 15 01:56:07 user nova-compute[73121]: and ``live_migration_inbound_addr`` respectively.
Aug 15 01:56:07 user nova-compute[73121]: ).  Its value may be silently ignored in the future.
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.live_migration_with_native_tls = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.max_queues             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.nfs_mount_options      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.num_pcie_ports         = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.pmem_namespaces        = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.quobyte_client_cfg     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rbd_secret_uuid        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rbd_user               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rescue_image_id        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rescue_kernel_id       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.rx_queue_size          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.smbfs_mount_options    =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.snapshot_compression   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.snapshot_image_format  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.sparse_logical_volumes = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.swtpm_enabled          = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.swtpm_group            = tss {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.swtpm_user             = tss {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.sysinfo_serial         = unique {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.tb_cache_size          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.tx_queue_size          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.uid_maps               = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.use_virtio_for_bridges = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.virt_type              = kvm {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.volume_clear           = zero {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.volume_clear_size      = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.volume_use_multipath   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.vzstorage_cache_path   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.auth_section           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.auth_type              = password {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.cafile                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.certfile               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.collect_timing         = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.connect_retries        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.connect_retry_delay    = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.default_floating_pool  = public {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.endpoint_override      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.extension_sync_interval = 600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.http_retries           = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.insecure               = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.keyfile                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.max_version            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.min_version            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.ovs_bridge             = br-int {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.physnets               = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.region_name            = RegionOne {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.service_metadata_proxy = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.service_name           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.service_type           = network {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.split_loggers          = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.status_code_retries    = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.status_code_retry_delay = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.timeout                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] neutron.version                = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] notifications.bdms_in_notifications = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] notifications.default_level    = INFO {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] notifications.notification_format = unversioned {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] notifications.notify_on_state_change = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] pci.alias                      = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] pci.device_spec                = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] pci.report_in_placement        = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.auth_section         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.auth_type            = password {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.cafile               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.certfile             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.collect_timing       = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.connect_retries      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.connect_retry_delay  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.default_domain_id    = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.default_domain_name  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.domain_id            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.domain_name          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.endpoint_override    = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.insecure             = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.keyfile              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.max_version          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.min_version          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.password             = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.project_domain_id    = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.project_domain_name  = Default {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.project_id           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.project_name         = service {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.region_name          = RegionOne {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.service_name         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.service_type         = placement {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.split_loggers        = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.status_code_retries  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.status_code_retry_delay = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.system_scope         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.timeout              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.trust_id             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.user_domain_id       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.user_domain_name     = Default {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.user_id              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.username             = placement {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] placement.version              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.cores                    = 20 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.count_usage_from_placement = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.injected_file_content_bytes = 10240 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.injected_file_path_length = 255 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.injected_files           = 5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.instances                = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.key_pairs                = 100 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.metadata_items           = 128 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.ram                      = 51200 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.recheck_quota            = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.server_group_members     = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] quota.server_groups            = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] rdp.enabled                    = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.image_metadata_prefilter = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.max_attempts         = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.max_placement_results = 1000 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] scheduler.workers              = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.host_subset_size = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.isolated_hosts = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.isolated_images = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.pci_in_placement = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.track_instance_changes = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] metrics.required               = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] metrics.weight_multiplier      = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] metrics.weight_setting         = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] serial_console.enabled         = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] serial_console.port_range      = 10000:20000 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] serial_console.serialproxy_port = 6083 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.auth_section      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.auth_type         = password {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.cafile            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.certfile          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.collect_timing    = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.insecure          = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.keyfile           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.send_service_user_token = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.split_loggers     = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] service_user.timeout           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.agent_enabled            = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.enabled                  = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.html5proxy_port          = 6082 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.image_compression        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.jpeg_compression         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.playback_compression     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.server_listen            = 127.0.0.1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.streaming_mode           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] spice.zlib_compression         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] upgrade_levels.baseapi         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] upgrade_levels.cert            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] upgrade_levels.compute         = auto {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] upgrade_levels.conductor       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] upgrade_levels.scheduler       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vendordata_dynamic_auth.cafile = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vendordata_dynamic_auth.certfile = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vendordata_dynamic_auth.insecure = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vendordata_dynamic_auth.timeout = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.api_retry_count         = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.ca_file                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.cache_prefix            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.cluster_name            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.connection_pool_size    = 10 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.console_delay_seconds   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.datastore_regex         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.host_ip                 = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.host_password           = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.host_port               = 443 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.host_username           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.insecure                = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.integration_bridge      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.maximum_objects         = 100 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.pbm_default_policy      = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.pbm_enabled             = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.pbm_wsdl_location       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.serial_port_proxy_uri   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.serial_port_service_uri = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.task_poll_interval      = 0.5 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.use_linked_clone        = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.vnc_keymap              = en-us {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.vnc_port                = 5900 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vmware.vnc_port_total          = 10000 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.auth_schemes               = ['none'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.enabled                    = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.novncproxy_port            = 6080 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.vencrypt_ca_certs          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.vencrypt_client_cert       = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vnc.vencrypt_client_key        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.disable_rootwrap   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.enable_numa_live_migration = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.libvirt_disable_apic = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.client_socket_timeout     = 900 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.default_pool_size         = 1000 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.keep_alive                = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.max_header_line           = 16384 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.ssl_ca_file               = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.ssl_cert_file             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.ssl_key_file              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.tcp_keepidle              = 600 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] zvm.ca_file                    = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] zvm.cloud_connector_url        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] zvm.reachable_timeout          = 300 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.enforce_new_defaults = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.enforce_scope      = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.policy_default_rule = default {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.connection_string     = messaging:// {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.enabled               = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.es_doc_type           = notification {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.es_scroll_size        = 10000 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.es_scroll_time        = 2m {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.filter_error_trace    = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.hmac_keys             = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.sentinel_service_name = mymaster {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.socket_timeout        = 0.1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.trace_requests        = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler.trace_sqlalchemy      = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler_jaeger.process_tags   = {} {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler_jaeger.service_name_prefix = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] profiler_otlp.service_name_prefix = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] remote_debug.host              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] remote_debug.port              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_notifications.retry = -1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.auth_section        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.auth_type           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.cafile              = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.certfile            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.collect_timing      = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.connect_retries     = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.connect_retry_delay = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.endpoint_id         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.endpoint_override   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.insecure            = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.keyfile             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.max_version         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.min_version         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.region_name         = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.service_name        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.service_type        = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.split_loggers       = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.status_code_retries = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.status_code_retry_delay = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.timeout             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.valid_interfaces    = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_limit.version             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_reports.file_event_handler = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] oslo_reports.log_dir           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_ovs_privileged.group  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] vif_plug_ovs_privileged.user   = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_ovs.isolate_vif         = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] os_brick.lock_path             = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] privsep_osbrick.capabilities   = [21] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] privsep_osbrick.group          = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] privsep_osbrick.helper_command = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] privsep_osbrick.user           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] nova_sys_admin.group           = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] nova_sys_admin.helper_command  = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] nova_sys_admin.user            = None {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG oslo_service.service [None req-1aa4d99f-158b-4049-b24f-e157a2b48282 None None] ******************************************************************************** {{(pid=73121) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 15 01:56:07 user nova-compute[73121]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 15 01:56:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Starting native event thread {{(pid=73121) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Starting green dispatch thread {{(pid=73121) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Starting connection event dispatch thread {{(pid=73121) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Connecting to libvirt: qemu:///system {{(pid=73121) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f1e297e8d90> {{(pid=73121) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 15 01:56:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f1e297e8d90> {{(pid=73121) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 15 01:56:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Connection event '1' reason 'None'
Aug 15 01:56:07 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 01:56:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.mount [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Initialising _HostMountState generation 0 {{(pid=73121) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 15 01:56:15 user nova-compute[73121]: INFO nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt host capabilities <capabilities>
Aug 15 01:56:15 user nova-compute[73121]:   <host>
Aug 15 01:56:15 user nova-compute[73121]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 15 01:56:15 user nova-compute[73121]:     <cpu>
Aug 15 01:56:15 user nova-compute[73121]:       <arch>x86_64</arch>
Aug 15 01:56:15 user nova-compute[73121]:       <model>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <vendor>Intel</vendor>
Aug 15 01:56:15 user nova-compute[73121]:       <microcode version='1070'/>
Aug 15 01:56:15 user nova-compute[73121]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 15 01:56:15 user nova-compute[73121]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='ss'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='vmx'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='pcid'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='osxsave'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='hypervisor'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='arat'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='tsc_adjust'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='md-clear'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='arch-capabilities'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='invtsc'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='rsba'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature name='skip-l1dfl-vmentry'/>
Aug 15 01:56:15 user nova-compute[73121]:       <pages unit='KiB' size='4'/>
Aug 15 01:56:15 user nova-compute[73121]:       <pages unit='KiB' size='2048'/>
Aug 15 01:56:15 user nova-compute[73121]:     </cpu>
Aug 15 01:56:15 user nova-compute[73121]:     <power_management>
Aug 15 01:56:15 user nova-compute[73121]:       <suspend_mem/>
Aug 15 01:56:15 user nova-compute[73121]:       <suspend_disk/>
Aug 15 01:56:15 user nova-compute[73121]:       <suspend_hybrid/>
Aug 15 01:56:15 user nova-compute[73121]:     </power_management>
Aug 15 01:56:15 user nova-compute[73121]:     <iommu support='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     <migration_features>
Aug 15 01:56:15 user nova-compute[73121]:       <live/>
Aug 15 01:56:15 user nova-compute[73121]:       <uri_transports>
Aug 15 01:56:15 user nova-compute[73121]:         <uri_transport>tcp</uri_transport>
Aug 15 01:56:15 user nova-compute[73121]:         <uri_transport>rdma</uri_transport>
Aug 15 01:56:15 user nova-compute[73121]:       </uri_transports>
Aug 15 01:56:15 user nova-compute[73121]:     </migration_features>
Aug 15 01:56:15 user nova-compute[73121]:     <topology>
Aug 15 01:56:15 user nova-compute[73121]:       <cells num='2'>
Aug 15 01:56:15 user nova-compute[73121]:         <cell id='0'>
Aug 15 01:56:15 user nova-compute[73121]:           <memory unit='KiB'>8140616</memory>
Aug 15 01:56:15 user nova-compute[73121]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 15 01:56:15 user nova-compute[73121]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 01:56:15 user nova-compute[73121]:           <distances>
Aug 15 01:56:15 user nova-compute[73121]:             <sibling id='0' value='10'/>
Aug 15 01:56:15 user nova-compute[73121]:             <sibling id='1' value='20'/>
Aug 15 01:56:15 user nova-compute[73121]:           </distances>
Aug 15 01:56:15 user nova-compute[73121]:           <cpus num='6'>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 15 01:56:15 user nova-compute[73121]:           </cpus>
Aug 15 01:56:15 user nova-compute[73121]:         </cell>
Aug 15 01:56:15 user nova-compute[73121]:         <cell id='1'>
Aug 15 01:56:15 user nova-compute[73121]:           <memory unit='KiB'>8255100</memory>
Aug 15 01:56:15 user nova-compute[73121]:           <pages unit='KiB' size='4'>2063775</pages>
Aug 15 01:56:15 user nova-compute[73121]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 01:56:15 user nova-compute[73121]:           <distances>
Aug 15 01:56:15 user nova-compute[73121]:             <sibling id='0' value='20'/>
Aug 15 01:56:15 user nova-compute[73121]:             <sibling id='1' value='10'/>
Aug 15 01:56:15 user nova-compute[73121]:           </distances>
Aug 15 01:56:15 user nova-compute[73121]:           <cpus num='6'>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 15 01:56:15 user nova-compute[73121]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 15 01:56:15 user nova-compute[73121]:           </cpus>
Aug 15 01:56:15 user nova-compute[73121]:         </cell>
Aug 15 01:56:15 user nova-compute[73121]:       </cells>
Aug 15 01:56:15 user nova-compute[73121]:     </topology>
Aug 15 01:56:15 user nova-compute[73121]:     <cache>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 15 01:56:15 user nova-compute[73121]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 15 01:56:15 user nova-compute[73121]:     </cache>
Aug 15 01:56:15 user nova-compute[73121]:     <secmodel>
Aug 15 01:56:15 user nova-compute[73121]:       <model>apparmor</model>
Aug 15 01:56:15 user nova-compute[73121]:       <doi>0</doi>
Aug 15 01:56:15 user nova-compute[73121]:     </secmodel>
Aug 15 01:56:15 user nova-compute[73121]:     <secmodel>
Aug 15 01:56:15 user nova-compute[73121]:       <model>dac</model>
Aug 15 01:56:15 user nova-compute[73121]:       <doi>0</doi>
Aug 15 01:56:15 user nova-compute[73121]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 15 01:56:15 user nova-compute[73121]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 15 01:56:15 user nova-compute[73121]:     </secmodel>
Aug 15 01:56:15 user nova-compute[73121]:   </host>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='alpha'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>clipper</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='armv6l'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>spitz</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>nuri</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>kzm</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sx1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>z2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>tosa</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>n810</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>n800</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>terrier</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>midway</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>microbit</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>verdex</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>highbank</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>akita</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>connex</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>collie</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='armv7l'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>spitz</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>nuri</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>kzm</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sx1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>z2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>tosa</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>n810</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>n800</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>terrier</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>midway</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>microbit</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>verdex</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>highbank</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>akita</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>connex</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>collie</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='aarch64'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>spitz</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>nuri</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>kzm</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sx1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>z2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>tosa</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>n810</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>n800</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>terrier</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>midway</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>microbit</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>verdex</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>raspi3b</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>highbank</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>akita</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>connex</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>collie</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <acpi default='on' toggle='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='cris'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='i686'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>isapc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>microvm</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='kvm'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <pae/>
Aug 15 01:56:15 user nova-compute[73121]:       <nonpae/>
Aug 15 01:56:15 user nova-compute[73121]:       <acpi default='on' toggle='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:       <apic default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='m68k'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>an5206</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>q800</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>next-cube</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='microblaze'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='microblazeel'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='mips'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='16'>malta</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='mipsel'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='16'>malta</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='mips64'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='16'>malta</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>pica61</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>magnum</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='mips64el'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='16'>malta</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>pica61</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>magnum</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='16'>boston</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='ppc'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mac99</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>40p</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>taihu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='ppc64'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>taihu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>40p</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mac99</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='ppc64le'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>taihu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>40p</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>mac99</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='riscv32'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='8'>spike</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>opentitan</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='8'>virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='riscv64'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='8'>spike</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>shakti_c</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='8'>virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='s390x'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='sh4'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>shix</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>r2d</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='sh4eb'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>shix</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>r2d</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='sparc'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>SS-5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>SS-20</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>LX</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>SS-4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>SS-10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>Voyager</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='sparc64'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sun4u</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>niagara</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>sun4v</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='x86_64'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>64</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='1'>isapc</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>microvm</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='kvm'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <acpi default='on' toggle='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:       <apic default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='xtensa'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>sim</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>kc705</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>ml605</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>lx200</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>lx60</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]:   <guest>
Aug 15 01:56:15 user nova-compute[73121]:     <os_type>hvm</os_type>
Aug 15 01:56:15 user nova-compute[73121]:     <arch name='xtensaeb'>
Aug 15 01:56:15 user nova-compute[73121]:       <wordsize>32</wordsize>
Aug 15 01:56:15 user nova-compute[73121]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='4'>sim</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>kc705</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>ml605</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>virt</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>lx200</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>lx60</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 01:56:15 user nova-compute[73121]:       <domain type='qemu'/>
Aug 15 01:56:15 user nova-compute[73121]:     </arch>
Aug 15 01:56:15 user nova-compute[73121]:     <features>
Aug 15 01:56:15 user nova-compute[73121]:       <cpuselection/>
Aug 15 01:56:15 user nova-compute[73121]:       <deviceboot/>
Aug 15 01:56:15 user nova-compute[73121]:       <disksnapshot default='on' toggle='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     </features>
Aug 15 01:56:15 user nova-compute[73121]:   </guest>
Aug 15 01:56:15 user nova-compute[73121]: </capabilities>
Aug 15 01:56:15 user nova-compute[73121]: 
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 15 01:56:15 user nova-compute[73121]: <domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 01:56:15 user nova-compute[73121]:   <domain>kvm</domain>
Aug 15 01:56:15 user nova-compute[73121]:   <machine>pc-i440fx-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:   <arch>i686</arch>
Aug 15 01:56:15 user nova-compute[73121]:   <vcpu max='255'/>
Aug 15 01:56:15 user nova-compute[73121]:   <iothreads supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:   <os supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='firmware'/>
Aug 15 01:56:15 user nova-compute[73121]:     <loader supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>rom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pflash</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='readonly'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='secure'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </loader>
Aug 15 01:56:15 user nova-compute[73121]:   </os>
Aug 15 01:56:15 user nova-compute[73121]:   <cpu>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-passthrough' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='hostPassthroughMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='maximum' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='maximumMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-model' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <vendor>Intel</vendor>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ss'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='vmx'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pcid'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='hypervisor'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arat'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='umip'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='md-clear'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibpb'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibrs'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='erms'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='lm'/>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='custom' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>qemu64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>qemu32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>phenom</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>n270</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>kvm64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>coreduo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>core2duo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>athlon</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Westmere</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Snowridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Penryn</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G5</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G4</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G1</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Nehalem</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Rome</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Milan</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Dhyana</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cooperlake</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Conroe</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>486</model>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:   </cpu>
Aug 15 01:56:15 user nova-compute[73121]:   <memoryBacking supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='sourceType'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>file</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>anonymous</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>memfd</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:   </memoryBacking>
Aug 15 01:56:15 user nova-compute[73121]:   <devices>
Aug 15 01:56:15 user nova-compute[73121]:     <disk supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='diskDevice'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>disk</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cdrom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>floppy</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>lun</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='bus'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ide</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>fdc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sata</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </disk>
Aug 15 01:56:15 user nova-compute[73121]:     <graphics supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sdl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vnc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>spice</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egl-headless</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </graphics>
Aug 15 01:56:15 user nova-compute[73121]:     <video supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='modelType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cirrus</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vmvga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>qxl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>none</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>bochs</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ramfb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </video>
Aug 15 01:56:15 user nova-compute[73121]:     <hostdev supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='mode'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>subsystem</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='startupPolicy'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>default</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>mandatory</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>requisite</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>optional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='subsysType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pci</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='capsType'/>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='pciBackend'/>
Aug 15 01:56:15 user nova-compute[73121]:     </hostdev>
Aug 15 01:56:15 user nova-compute[73121]:     <rng supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>random</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egd</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>builtin</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </rng>
Aug 15 01:56:15 user nova-compute[73121]:     <filesystem supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='driverType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>path</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>handle</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtiofs</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </filesystem>
Aug 15 01:56:15 user nova-compute[73121]:     <tpm supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-tis</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-crb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>passthrough</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>emulator</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </tpm>
Aug 15 01:56:15 user nova-compute[73121]:   </devices>
Aug 15 01:56:15 user nova-compute[73121]:   <features>
Aug 15 01:56:15 user nova-compute[73121]:     <gic supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     <vmcoreinfo supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <genid supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backingStoreInput supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backup supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <sev supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:   </features>
Aug 15 01:56:15 user nova-compute[73121]: </domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:  {{(pid=73121) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 15 01:56:15 user nova-compute[73121]: <domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 01:56:15 user nova-compute[73121]:   <domain>kvm</domain>
Aug 15 01:56:15 user nova-compute[73121]:   <machine>pc-i440fx-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:   <arch>i686</arch>
Aug 15 01:56:15 user nova-compute[73121]:   <vcpu max='255'/>
Aug 15 01:56:15 user nova-compute[73121]:   <iothreads supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:   <os supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='firmware'/>
Aug 15 01:56:15 user nova-compute[73121]:     <loader supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>rom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pflash</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='readonly'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='secure'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </loader>
Aug 15 01:56:15 user nova-compute[73121]:   </os>
Aug 15 01:56:15 user nova-compute[73121]:   <cpu>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-passthrough' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='hostPassthroughMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='maximum' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='maximumMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-model' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <vendor>Intel</vendor>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ss'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='vmx'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pcid'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='hypervisor'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arat'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='umip'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='md-clear'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibpb'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibrs'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='erms'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='lm'/>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='custom' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>qemu64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>qemu32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>phenom</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>n270</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>kvm64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>coreduo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>core2duo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>athlon</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Westmere</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Snowridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Penryn</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G5</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G4</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G1</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Nehalem</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Rome</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Milan</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Dhyana</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cooperlake</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Conroe</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>486</model>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:   </cpu>
Aug 15 01:56:15 user nova-compute[73121]:   <memoryBacking supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='sourceType'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>file</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>anonymous</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>memfd</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:   </memoryBacking>
Aug 15 01:56:15 user nova-compute[73121]:   <devices>
Aug 15 01:56:15 user nova-compute[73121]:     <disk supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='diskDevice'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>disk</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cdrom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>floppy</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>lun</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='bus'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ide</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>fdc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sata</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </disk>
Aug 15 01:56:15 user nova-compute[73121]:     <graphics supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sdl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vnc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>spice</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egl-headless</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </graphics>
Aug 15 01:56:15 user nova-compute[73121]:     <video supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='modelType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cirrus</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vmvga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>qxl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>none</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>bochs</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ramfb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </video>
Aug 15 01:56:15 user nova-compute[73121]:     <hostdev supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='mode'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>subsystem</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='startupPolicy'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>default</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>mandatory</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>requisite</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>optional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='subsysType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pci</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='capsType'/>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='pciBackend'/>
Aug 15 01:56:15 user nova-compute[73121]:     </hostdev>
Aug 15 01:56:15 user nova-compute[73121]:     <rng supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>random</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egd</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>builtin</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </rng>
Aug 15 01:56:15 user nova-compute[73121]:     <filesystem supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='driverType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>path</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>handle</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtiofs</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </filesystem>
Aug 15 01:56:15 user nova-compute[73121]:     <tpm supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-tis</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-crb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>passthrough</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>emulator</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </tpm>
Aug 15 01:56:15 user nova-compute[73121]:   </devices>
Aug 15 01:56:15 user nova-compute[73121]:   <features>
Aug 15 01:56:15 user nova-compute[73121]:     <gic supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     <vmcoreinfo supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <genid supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backingStoreInput supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backup supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <sev supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:   </features>
Aug 15 01:56:15 user nova-compute[73121]: </domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:  {{(pid=73121) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 15 01:56:15 user nova-compute[73121]: <domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 01:56:15 user nova-compute[73121]:   <domain>kvm</domain>
Aug 15 01:56:15 user nova-compute[73121]:   <machine>pc-q35-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:   <arch>i686</arch>
Aug 15 01:56:15 user nova-compute[73121]:   <vcpu max='288'/>
Aug 15 01:56:15 user nova-compute[73121]:   <iothreads supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:   <os supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='firmware'/>
Aug 15 01:56:15 user nova-compute[73121]:     <loader supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>rom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pflash</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='readonly'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='secure'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </loader>
Aug 15 01:56:15 user nova-compute[73121]:   </os>
Aug 15 01:56:15 user nova-compute[73121]:   <cpu>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-passthrough' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='hostPassthroughMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='maximum' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='maximumMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-model' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <vendor>Intel</vendor>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ss'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='vmx'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pcid'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='hypervisor'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arat'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='umip'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='md-clear'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibpb'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibrs'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='erms'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='lm'/>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='custom' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>qemu64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>qemu32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>phenom</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>n270</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>kvm64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>coreduo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>core2duo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>athlon</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Westmere</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Snowridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Penryn</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G5</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G4</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G1</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Nehalem</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Rome</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Milan</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Dhyana</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cooperlake</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Conroe</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>486</model>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:   </cpu>
Aug 15 01:56:15 user nova-compute[73121]:   <memoryBacking supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='sourceType'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>file</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>anonymous</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>memfd</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:   </memoryBacking>
Aug 15 01:56:15 user nova-compute[73121]:   <devices>
Aug 15 01:56:15 user nova-compute[73121]:     <disk supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='diskDevice'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>disk</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cdrom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>floppy</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>lun</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='bus'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>fdc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sata</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </disk>
Aug 15 01:56:15 user nova-compute[73121]:     <graphics supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sdl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vnc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>spice</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egl-headless</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </graphics>
Aug 15 01:56:15 user nova-compute[73121]:     <video supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='modelType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cirrus</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vmvga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>qxl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>none</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>bochs</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ramfb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </video>
Aug 15 01:56:15 user nova-compute[73121]:     <hostdev supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='mode'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>subsystem</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='startupPolicy'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>default</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>mandatory</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>requisite</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>optional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='subsysType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pci</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='capsType'/>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='pciBackend'/>
Aug 15 01:56:15 user nova-compute[73121]:     </hostdev>
Aug 15 01:56:15 user nova-compute[73121]:     <rng supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>random</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egd</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>builtin</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </rng>
Aug 15 01:56:15 user nova-compute[73121]:     <filesystem supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='driverType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>path</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>handle</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtiofs</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </filesystem>
Aug 15 01:56:15 user nova-compute[73121]:     <tpm supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-tis</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-crb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>passthrough</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>emulator</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </tpm>
Aug 15 01:56:15 user nova-compute[73121]:   </devices>
Aug 15 01:56:15 user nova-compute[73121]:   <features>
Aug 15 01:56:15 user nova-compute[73121]:     <gic supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     <vmcoreinfo supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <genid supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backingStoreInput supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backup supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <sev supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:   </features>
Aug 15 01:56:15 user nova-compute[73121]: </domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:  {{(pid=73121) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 15 01:56:15 user nova-compute[73121]: <domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 01:56:15 user nova-compute[73121]:   <domain>kvm</domain>
Aug 15 01:56:15 user nova-compute[73121]:   <machine>pc-q35-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:   <arch>i686</arch>
Aug 15 01:56:15 user nova-compute[73121]:   <vcpu max='288'/>
Aug 15 01:56:15 user nova-compute[73121]:   <iothreads supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:   <os supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='firmware'/>
Aug 15 01:56:15 user nova-compute[73121]:     <loader supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>rom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pflash</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='readonly'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='secure'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </loader>
Aug 15 01:56:15 user nova-compute[73121]:   </os>
Aug 15 01:56:15 user nova-compute[73121]:   <cpu>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-passthrough' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='hostPassthroughMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='maximum' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='maximumMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-model' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <vendor>Intel</vendor>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ss'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='vmx'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pcid'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='hypervisor'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arat'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='umip'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='md-clear'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibpb'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibrs'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='erms'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='lm'/>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='custom' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>qemu64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>qemu32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>phenom</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>n270</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>kvm64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>coreduo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>core2duo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>athlon</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Westmere</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Snowridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Penryn</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G5</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G4</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G1</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Nehalem</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Rome</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Milan</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Dhyana</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cooperlake</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Conroe</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>486</model>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:   </cpu>
Aug 15 01:56:15 user nova-compute[73121]:   <memoryBacking supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='sourceType'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>file</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>anonymous</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>memfd</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:   </memoryBacking>
Aug 15 01:56:15 user nova-compute[73121]:   <devices>
Aug 15 01:56:15 user nova-compute[73121]:     <disk supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='diskDevice'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>disk</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cdrom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>floppy</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>lun</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='bus'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>fdc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sata</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </disk>
Aug 15 01:56:15 user nova-compute[73121]:     <graphics supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sdl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vnc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>spice</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egl-headless</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </graphics>
Aug 15 01:56:15 user nova-compute[73121]:     <video supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='modelType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cirrus</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vmvga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>qxl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>none</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>bochs</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ramfb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </video>
Aug 15 01:56:15 user nova-compute[73121]:     <hostdev supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='mode'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>subsystem</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='startupPolicy'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>default</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>mandatory</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>requisite</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>optional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='subsysType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pci</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='capsType'/>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='pciBackend'/>
Aug 15 01:56:15 user nova-compute[73121]:     </hostdev>
Aug 15 01:56:15 user nova-compute[73121]:     <rng supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>random</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egd</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>builtin</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </rng>
Aug 15 01:56:15 user nova-compute[73121]:     <filesystem supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='driverType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>path</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>handle</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtiofs</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </filesystem>
Aug 15 01:56:15 user nova-compute[73121]:     <tpm supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-tis</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-crb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>passthrough</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>emulator</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </tpm>
Aug 15 01:56:15 user nova-compute[73121]:   </devices>
Aug 15 01:56:15 user nova-compute[73121]:   <features>
Aug 15 01:56:15 user nova-compute[73121]:     <gic supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     <vmcoreinfo supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <genid supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backingStoreInput supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backup supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <sev supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:   </features>
Aug 15 01:56:15 user nova-compute[73121]: </domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:  {{(pid=73121) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 15 01:56:15 user nova-compute[73121]: <domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 01:56:15 user nova-compute[73121]:   <domain>kvm</domain>
Aug 15 01:56:15 user nova-compute[73121]:   <machine>pc-i440fx-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:   <arch>x86_64</arch>
Aug 15 01:56:15 user nova-compute[73121]:   <vcpu max='255'/>
Aug 15 01:56:15 user nova-compute[73121]:   <iothreads supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:   <os supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='firmware'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>efi</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:     <loader supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>rom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pflash</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='readonly'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='secure'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </loader>
Aug 15 01:56:15 user nova-compute[73121]:   </os>
Aug 15 01:56:15 user nova-compute[73121]:   <cpu>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-passthrough' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='hostPassthroughMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='maximum' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='maximumMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-model' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <vendor>Intel</vendor>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ss'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='vmx'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pcid'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='hypervisor'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arat'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='umip'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='md-clear'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='invtsc'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibpb'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibrs'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='rsba'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='erms'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='custom' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>qemu64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>qemu32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>phenom</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>n270</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>coreduo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>core2duo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>athlon</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Westmere</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Snowridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Penryn</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G5</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G4</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Opteron_G1</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Nehalem</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Rome</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Milan</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Dhyana</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cooperlake</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Conroe</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>486</model>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:   </cpu>
Aug 15 01:56:15 user nova-compute[73121]:   <memoryBacking supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='sourceType'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>file</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>anonymous</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>memfd</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:   </memoryBacking>
Aug 15 01:56:15 user nova-compute[73121]:   <devices>
Aug 15 01:56:15 user nova-compute[73121]:     <disk supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='diskDevice'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>disk</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cdrom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>floppy</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>lun</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='bus'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ide</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>fdc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sata</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </disk>
Aug 15 01:56:15 user nova-compute[73121]:     <graphics supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sdl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vnc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>spice</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egl-headless</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </graphics>
Aug 15 01:56:15 user nova-compute[73121]:     <video supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='modelType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cirrus</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vmvga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>qxl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>none</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>bochs</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ramfb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </video>
Aug 15 01:56:15 user nova-compute[73121]:     <hostdev supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='mode'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>subsystem</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='startupPolicy'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>default</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>mandatory</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>requisite</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>optional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='subsysType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pci</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='capsType'/>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='pciBackend'/>
Aug 15 01:56:15 user nova-compute[73121]:     </hostdev>
Aug 15 01:56:15 user nova-compute[73121]:     <rng supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>random</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egd</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>builtin</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </rng>
Aug 15 01:56:15 user nova-compute[73121]:     <filesystem supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='driverType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>path</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>handle</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtiofs</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </filesystem>
Aug 15 01:56:15 user nova-compute[73121]:     <tpm supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-tis</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-crb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>passthrough</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>emulator</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </tpm>
Aug 15 01:56:15 user nova-compute[73121]:   </devices>
Aug 15 01:56:15 user nova-compute[73121]:   <features>
Aug 15 01:56:15 user nova-compute[73121]:     <gic supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     <vmcoreinfo supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <genid supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backingStoreInput supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backup supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <sev supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:   </features>
Aug 15 01:56:15 user nova-compute[73121]: </domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:  {{(pid=73121) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 15 01:56:15 user nova-compute[73121]: <domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 01:56:15 user nova-compute[73121]:   <domain>kvm</domain>
Aug 15 01:56:15 user nova-compute[73121]:   <machine>pc-i440fx-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:   <arch>x86_64</arch>
Aug 15 01:56:15 user nova-compute[73121]:   <vcpu max='255'/>
Aug 15 01:56:15 user nova-compute[73121]:   <iothreads supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:   <os supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='firmware'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>efi</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:     <loader supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>rom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pflash</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='readonly'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='secure'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </loader>
Aug 15 01:56:15 user nova-compute[73121]:   </os>
Aug 15 01:56:15 user nova-compute[73121]:   <cpu>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-passthrough' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='hostPassthroughMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='maximum' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='maximumMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-model' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <vendor>Intel</vendor>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ss'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='vmx'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pcid'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='hypervisor'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arat'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='umip'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='md-clear'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='invtsc'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibpb'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibrs'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='rsba'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='erms'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='custom' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>qemu64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>qemu32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>phenom</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>n270</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>coreduo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>core2duo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>athlon</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Westmere</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Snowridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Penryn</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G5</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G4</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Opteron_G1</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Nehalem</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Rome</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Milan</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Dhyana</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cooperlake</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Conroe</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>486</model>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:   </cpu>
Aug 15 01:56:15 user nova-compute[73121]:   <memoryBacking supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='sourceType'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>file</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>anonymous</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>memfd</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:   </memoryBacking>
Aug 15 01:56:15 user nova-compute[73121]:   <devices>
Aug 15 01:56:15 user nova-compute[73121]:     <disk supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='diskDevice'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>disk</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cdrom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>floppy</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>lun</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='bus'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ide</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>fdc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sata</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </disk>
Aug 15 01:56:15 user nova-compute[73121]:     <graphics supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sdl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vnc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>spice</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egl-headless</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </graphics>
Aug 15 01:56:15 user nova-compute[73121]:     <video supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='modelType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cirrus</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vmvga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>qxl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>none</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>bochs</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ramfb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </video>
Aug 15 01:56:15 user nova-compute[73121]:     <hostdev supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='mode'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>subsystem</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='startupPolicy'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>default</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>mandatory</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>requisite</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>optional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='subsysType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pci</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='capsType'/>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='pciBackend'/>
Aug 15 01:56:15 user nova-compute[73121]:     </hostdev>
Aug 15 01:56:15 user nova-compute[73121]:     <rng supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>random</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egd</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>builtin</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </rng>
Aug 15 01:56:15 user nova-compute[73121]:     <filesystem supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='driverType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>path</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>handle</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtiofs</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </filesystem>
Aug 15 01:56:15 user nova-compute[73121]:     <tpm supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-tis</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-crb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>passthrough</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>emulator</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </tpm>
Aug 15 01:56:15 user nova-compute[73121]:   </devices>
Aug 15 01:56:15 user nova-compute[73121]:   <features>
Aug 15 01:56:15 user nova-compute[73121]:     <gic supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     <vmcoreinfo supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <genid supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backingStoreInput supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backup supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <sev supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:   </features>
Aug 15 01:56:15 user nova-compute[73121]: </domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:  {{(pid=73121) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 15 01:56:15 user nova-compute[73121]: <domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 01:56:15 user nova-compute[73121]:   <domain>kvm</domain>
Aug 15 01:56:15 user nova-compute[73121]:   <machine>pc-q35-6.2</machine>
Aug 15 01:56:15 user nova-compute[73121]:   <arch>x86_64</arch>
Aug 15 01:56:15 user nova-compute[73121]:   <vcpu max='288'/>
Aug 15 01:56:15 user nova-compute[73121]:   <iothreads supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:   <os supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='firmware'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>efi</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:     <loader supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>rom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pflash</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='readonly'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='secure'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </loader>
Aug 15 01:56:15 user nova-compute[73121]:   </os>
Aug 15 01:56:15 user nova-compute[73121]:   <cpu>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-passthrough' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='hostPassthroughMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='maximum' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='maximumMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-model' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <vendor>Intel</vendor>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ss'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='vmx'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pcid'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='hypervisor'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arat'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='umip'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='md-clear'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='invtsc'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibpb'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibrs'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='rsba'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='erms'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='custom' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>qemu64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>qemu32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>phenom</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>n270</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>coreduo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>core2duo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>athlon</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Westmere</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Snowridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Penryn</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G5</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G4</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Opteron_G1</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Nehalem</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Rome</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Milan</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Dhyana</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cooperlake</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Conroe</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>486</model>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:   </cpu>
Aug 15 01:56:15 user nova-compute[73121]:   <memoryBacking supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='sourceType'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>file</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>anonymous</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>memfd</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:   </memoryBacking>
Aug 15 01:56:15 user nova-compute[73121]:   <devices>
Aug 15 01:56:15 user nova-compute[73121]:     <disk supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='diskDevice'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>disk</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cdrom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>floppy</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>lun</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='bus'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>fdc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sata</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </disk>
Aug 15 01:56:15 user nova-compute[73121]:     <graphics supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sdl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vnc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>spice</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egl-headless</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </graphics>
Aug 15 01:56:15 user nova-compute[73121]:     <video supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='modelType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cirrus</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vmvga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>qxl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>none</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>bochs</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ramfb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </video>
Aug 15 01:56:15 user nova-compute[73121]:     <hostdev supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='mode'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>subsystem</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='startupPolicy'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>default</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>mandatory</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>requisite</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>optional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='subsysType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pci</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='capsType'/>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='pciBackend'/>
Aug 15 01:56:15 user nova-compute[73121]:     </hostdev>
Aug 15 01:56:15 user nova-compute[73121]:     <rng supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>random</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egd</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>builtin</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </rng>
Aug 15 01:56:15 user nova-compute[73121]:     <filesystem supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='driverType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>path</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>handle</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtiofs</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </filesystem>
Aug 15 01:56:15 user nova-compute[73121]:     <tpm supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-tis</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-crb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>passthrough</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>emulator</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </tpm>
Aug 15 01:56:15 user nova-compute[73121]:   </devices>
Aug 15 01:56:15 user nova-compute[73121]:   <features>
Aug 15 01:56:15 user nova-compute[73121]:     <gic supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     <vmcoreinfo supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <genid supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backingStoreInput supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backup supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <sev supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:   </features>
Aug 15 01:56:15 user nova-compute[73121]: </domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:  {{(pid=73121) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 15 01:56:15 user nova-compute[73121]: <domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 01:56:15 user nova-compute[73121]:   <domain>kvm</domain>
Aug 15 01:56:15 user nova-compute[73121]:   <machine>pc-q35-jammy</machine>
Aug 15 01:56:15 user nova-compute[73121]:   <arch>x86_64</arch>
Aug 15 01:56:15 user nova-compute[73121]:   <vcpu max='288'/>
Aug 15 01:56:15 user nova-compute[73121]:   <iothreads supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:   <os supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='firmware'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>efi</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:     <loader supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>rom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pflash</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='readonly'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='secure'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>yes</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>no</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </loader>
Aug 15 01:56:15 user nova-compute[73121]:   </os>
Aug 15 01:56:15 user nova-compute[73121]:   <cpu>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-passthrough' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='hostPassthroughMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='maximum' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='maximumMigratable'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>on</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>off</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='host-model' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <vendor>Intel</vendor>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ss'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='vmx'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pcid'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='hypervisor'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arat'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='umip'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='md-clear'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='invtsc'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibpb'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='ibrs'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-stibp'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='rsba'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='erms'/>
Aug 15 01:56:15 user nova-compute[73121]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:     <mode name='custom' supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>qemu64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>qemu32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>phenom</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>pentium</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>n270</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm64</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>kvm32</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>coreduo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>core2duo</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>athlon</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Westmere</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Snowridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Skylake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>SandyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Penryn</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G5</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G4</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G3</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Opteron_G2</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Opteron_G1</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Nehalem</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>IvyBridge</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Icelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Haswell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Rome</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-Milan</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>EPYC</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Dhyana</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cooperlake</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>Conroe</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='no'>Broadwell</model>
Aug 15 01:56:15 user nova-compute[73121]:       <model usable='yes'>486</model>
Aug 15 01:56:15 user nova-compute[73121]:     </mode>
Aug 15 01:56:15 user nova-compute[73121]:   </cpu>
Aug 15 01:56:15 user nova-compute[73121]:   <memoryBacking supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:     <enum name='sourceType'>
Aug 15 01:56:15 user nova-compute[73121]:       <value>file</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>anonymous</value>
Aug 15 01:56:15 user nova-compute[73121]:       <value>memfd</value>
Aug 15 01:56:15 user nova-compute[73121]:     </enum>
Aug 15 01:56:15 user nova-compute[73121]:   </memoryBacking>
Aug 15 01:56:15 user nova-compute[73121]:   <devices>
Aug 15 01:56:15 user nova-compute[73121]:     <disk supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='diskDevice'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>disk</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cdrom</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>floppy</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>lun</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='bus'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>fdc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sata</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </disk>
Aug 15 01:56:15 user nova-compute[73121]:     <graphics supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='type'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>sdl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vnc</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>spice</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egl-headless</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </graphics>
Aug 15 01:56:15 user nova-compute[73121]:     <video supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='modelType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>cirrus</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>vmvga</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>qxl</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>none</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>bochs</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>ramfb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </video>
Aug 15 01:56:15 user nova-compute[73121]:     <hostdev supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='mode'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>subsystem</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='startupPolicy'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>default</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>mandatory</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>requisite</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>optional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='subsysType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>usb</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>pci</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>scsi</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='capsType'/>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='pciBackend'/>
Aug 15 01:56:15 user nova-compute[73121]:     </hostdev>
Aug 15 01:56:15 user nova-compute[73121]:     <rng supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtio-non-transitional</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>random</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>egd</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>builtin</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </rng>
Aug 15 01:56:15 user nova-compute[73121]:     <filesystem supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='driverType'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>path</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>handle</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>virtiofs</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </filesystem>
Aug 15 01:56:15 user nova-compute[73121]:     <tpm supported='yes'>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='model'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-tis</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>tpm-crb</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:       <enum name='backendModel'>
Aug 15 01:56:15 user nova-compute[73121]:         <value>passthrough</value>
Aug 15 01:56:15 user nova-compute[73121]:         <value>emulator</value>
Aug 15 01:56:15 user nova-compute[73121]:       </enum>
Aug 15 01:56:15 user nova-compute[73121]:     </tpm>
Aug 15 01:56:15 user nova-compute[73121]:   </devices>
Aug 15 01:56:15 user nova-compute[73121]:   <features>
Aug 15 01:56:15 user nova-compute[73121]:     <gic supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:     <vmcoreinfo supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <genid supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backingStoreInput supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <backup supported='yes'/>
Aug 15 01:56:15 user nova-compute[73121]:     <sev supported='no'/>
Aug 15 01:56:15 user nova-compute[73121]:   </features>
Aug 15 01:56:15 user nova-compute[73121]: </domainCapabilities>
Aug 15 01:56:15 user nova-compute[73121]:  {{(pid=73121) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73121) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73121) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Checking secure boot support for host arch (x86_64) {{(pid=73121) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Checking secure boot support for host arch (x86_64) {{(pid=73121) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Checking secure boot support for host arch (x86_64) {{(pid=73121) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Checking secure boot support for host arch (x86_64) {{(pid=73121) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Checking secure boot support for host arch (x86_64) {{(pid=73121) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 01:56:15 user nova-compute[73121]: INFO nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Secure Boot support detected
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] cpu compare xml: <cpu match="exact">
Aug 15 01:56:15 user nova-compute[73121]:   <model>Nehalem</model>
Aug 15 01:56:15 user nova-compute[73121]: </cpu>
Aug 15 01:56:15 user nova-compute[73121]:  {{(pid=73121) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 15 01:56:15 user nova-compute[73121]: INFO nova.virt.node [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Generated node identity f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf
Aug 15 01:56:15 user nova-compute[73121]: INFO nova.virt.node [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Wrote node identity f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf to /opt/stack/data/nova/compute_id
Aug 15 01:56:15 user nova-compute[73121]: WARNING nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Compute nodes ['f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 15 01:56:15 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 15 01:56:15 user nova-compute[73121]: WARNING nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 01:56:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:56:15 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:56:15 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:56:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Hypervisor/Node resource view: name=user free_ram=10849MB free_disk=26.32659149169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:56:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:56:16 user nova-compute[73121]: WARNING nova.compute.resource_tracker [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] No compute node record for user:f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf could not be found.
Aug 15 01:56:16 user nova-compute[73121]: INFO nova.compute.resource_tracker [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Compute node record created for user:user with uuid: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:56:16 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [req-73efd747-00bb-42fb-8198-cbecb41fd7e6] Created resource provider record via placement API for resource provider with UUID f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf and name user.
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73121) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 15 01:56:16 user nova-compute[73121]: INFO nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] kernel doesn't support AMD SEV
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Libvirt baseline CPU <cpu>
Aug 15 01:56:16 user nova-compute[73121]:   <arch>x86_64</arch>
Aug 15 01:56:16 user nova-compute[73121]:   <model>Nehalem</model>
Aug 15 01:56:16 user nova-compute[73121]:   <vendor>Intel</vendor>
Aug 15 01:56:16 user nova-compute[73121]:   <topology sockets="6" cores="1" threads="1"/>
Aug 15 01:56:16 user nova-compute[73121]: </cpu>
Aug 15 01:56:16 user nova-compute[73121]:  {{(pid=73121) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Updated inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Updating resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf generation from 0 to 1 during operation: update_inventory {{(pid=73121) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Updating resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf generation from 1 to 2 during operation: update_traits {{(pid=73121) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.service [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Creating RPC server for service compute {{(pid=73121) start /opt/stack/nova/nova/service.py:182}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.service [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Join ServiceGroup membership for this service compute {{(pid=73121) start /opt/stack/nova/nova/service.py:199}}
Aug 15 01:56:16 user nova-compute[73121]: DEBUG nova.servicegroup.drivers.db [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73121) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 15 01:56:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:56:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:57:07 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:57:07 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=10242MB free_disk=26.230304718017578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:57:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:58:07 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:58:07 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:58:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=10189MB free_disk=26.27737045288086GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:58:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:58:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:58:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:58:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:58:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:59:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 01:59:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:59:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=10216MB free_disk=26.06060028076172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 01:59:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 01:59:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:59:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:59:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 01:59:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:59:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 01:59:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:00:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:00:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 02:00:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:00:10 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:10 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:10 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=9479MB free_disk=26.08370590209961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:00:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:00:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:13 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:13 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:00:19 user nova-compute[73121]: INFO nova.compute.claims [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Claim successful on node user
Aug 15 02:00:19 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:00:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:00:19 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:00:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:00:20 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Creating image(s)
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "/opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "/opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.policy [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d8ef0b0581e4a10b066c15119bafde1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea879c6a9d1f4d58998e077524a07225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:00:20 user nova-compute[73121]: INFO nova.compute.claims [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Claim successful on node user
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a.part --force-share --output=json" returned: 0 in 0.164s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.virt.images [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a.part /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a.part /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a.converted" returned: 0 in 0.332s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:00:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:00:21 user nova-compute[73121]: DEBUG nova.network.neutron [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:00:21 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:00:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a.converted --force-share --output=json" returned: 0 in 0.167s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.044s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:21 user nova-compute[73121]: INFO oslo.privsep.daemon [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp152_8wcv/privsep.sock']
Aug 15 02:00:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:00:21 user sudo[82348]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp152_8wcv/privsep.sock
Aug 15 02:00:21 user sudo[82348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 02:00:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:00:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:00:21 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Creating image(s)
Aug 15 02:00:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "/opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "/opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:21 user nova-compute[73121]: DEBUG nova.policy [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c555808f8b84962b88920df9f029648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16eb9362b3cd4011b8c7bae927a6edd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.005s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:00:22 user nova-compute[73121]: INFO nova.compute.claims [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Claim successful on node user
Aug 15 02:00:22 user sudo[82348]: pam_unix(sudo:session): session closed for user root
Aug 15 02:00:22 user nova-compute[73121]: INFO oslo.privsep.daemon [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Spawned new privsep daemon via rootwrap
Aug 15 02:00:22 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 02:00:22 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 02:00:22 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 15 02:00:22 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82411
Aug 15 02:00:22 user nova-compute[73121]: WARNING oslo_privsep.priv_context [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] privsep daemon already running
Aug 15 02:00:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.354s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.network.neutron [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:00:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Successfully created port: d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.197s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:00:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Creating image(s)
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "/opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "/opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk 1073741824" returned: 0 in 0.044s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.247s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.policy [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4105e54b7264bb3aa05ceeccbf32277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104f505852da4e74b4afddadf5b4a9a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.201s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk 1073741824" returned: 0 in 0.044s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.042s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Cannot resize image /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'migration_context' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Ensure instance console log exists: /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk 1073741824" returned: 0 in 0.039s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.288s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.network.neutron [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Successfully created port: 896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.162s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Cannot resize image /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:00:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'migration_context' on Instance uuid ad8b33e3-c58c-4182-a43a-248f5f1face1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Ensure instance console log exists: /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Cannot resize image /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lazy-loading 'migration_context' on Instance uuid 4e04a498-4518-46c9-bc49-4d0d5d6aa054 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Ensure instance console log exists: /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "78cda252-7cca-412c-ac97-24fc375d32de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:00:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:25 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:00:25 user nova-compute[73121]: INFO nova.compute.claims [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Claim successful on node user
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Successfully created port: 963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:00:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:00:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Creating image(s)
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "/opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "/opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "/opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.170s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG nova.policy [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47877ca691894793a44512cecf6218e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df1cae4eab914ce5abe90d931e112c5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.167s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk 1073741824" returned: 0 in 0.042s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Successfully updated port: d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquired lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Cannot resize image /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lazy-loading 'migration_context' on Instance uuid 78cda252-7cca-412c-ac97-24fc375d32de {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Ensure instance console log exists: /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-fd95945b-e096-49ef-86fa-87e12eb0d7ec req-340e0c6d-4b00-481b-a138-c9057d799153 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received event network-changed-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-fd95945b-e096-49ef-86fa-87e12eb0d7ec req-340e0c6d-4b00-481b-a138-c9057d799153 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Refreshing instance network info cache due to event network-changed-d3309b3f-6cf7-4ab3-92df-54f35121ff91. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:00:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fd95945b-e096-49ef-86fa-87e12eb0d7ec req-340e0c6d-4b00-481b-a138-c9057d799153 service nova] Acquiring lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:28 user nova-compute[73121]: DEBUG nova.network.neutron [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Successfully updated port: 896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:00:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquired lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:28 user nova-compute[73121]: DEBUG nova.network.neutron [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:00:28 user nova-compute[73121]: DEBUG nova.network.neutron [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:00:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-7798fefe-2bb5-4381-8a4d-27e2d5b3b8ac req-fc980283-abc7-4e97-a94d-39dc46e7e6e6 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-changed-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-7798fefe-2bb5-4381-8a4d-27e2d5b3b8ac req-fc980283-abc7-4e97-a94d-39dc46e7e6e6 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Refreshing instance network info cache due to event network-changed-896acc02-dd7e-4464-be83-5a9774c03d22. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:00:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7798fefe-2bb5-4381-8a4d-27e2d5b3b8ac req-fc980283-abc7-4e97-a94d-39dc46e7e6e6 service nova] Acquiring lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updating instance_info_cache with network_info: [{"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Releasing lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Instance network_info: |[{"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fd95945b-e096-49ef-86fa-87e12eb0d7ec req-340e0c6d-4b00-481b-a138-c9057d799153 service nova] Acquired lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.neutron [req-fd95945b-e096-49ef-86fa-87e12eb0d7ec req-340e0c6d-4b00-481b-a138-c9057d799153 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Refreshing network info cache for port d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Start _get_guest_xml network_info=[{"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:00:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-227119013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-227119013',id=1,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-03v2ficv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:20Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=ad8b33e3-c58c-4182-a43a-248f5f1face1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ef:02,bridge_name='br-int',has_traffic_filtering=True,id=d3309b3f-6cf7-4ab3-92df-54f35121ff91,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3309b3f-6c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'pci_devices' on Instance uuid ad8b33e3-c58c-4182-a43a-248f5f1face1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:00:29 user nova-compute[73121]:   <uuid>ad8b33e3-c58c-4182-a43a-248f5f1face1</uuid>
Aug 15 02:00:29 user nova-compute[73121]:   <name>instance-00000001</name>
Aug 15 02:00:29 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:00:29 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:00:29 user nova-compute[73121]:   <metadata>
Aug 15 02:00:29 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:00:29 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-227119013</nova:name>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:00:29</nova:creationTime>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:00:29 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:00:29 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:owner>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:user uuid="4d8ef0b0581e4a10b066c15119bafde1">tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member</nova:user>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:project uuid="ea879c6a9d1f4d58998e077524a07225">tempest-ServerBootFromVolumeStableRescueTest-893410799</nova:project>
Aug 15 02:00:29 user nova-compute[73121]:       </nova:owner>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:ports>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:port uuid="d3309b3f-6cf7-4ab3-92df-54f35121ff91">
Aug 15 02:00:29 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 02:00:29 user nova-compute[73121]:         </nova:port>
Aug 15 02:00:29 user nova-compute[73121]:       </nova:ports>
Aug 15 02:00:29 user nova-compute[73121]:     </nova:instance>
Aug 15 02:00:29 user nova-compute[73121]:   </metadata>
Aug 15 02:00:29 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:00:29 user nova-compute[73121]:     <system>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="serial">ad8b33e3-c58c-4182-a43a-248f5f1face1</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="uuid">ad8b33e3-c58c-4182-a43a-248f5f1face1</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:00:29 user nova-compute[73121]:     </system>
Aug 15 02:00:29 user nova-compute[73121]:   </sysinfo>
Aug 15 02:00:29 user nova-compute[73121]:   <os>
Aug 15 02:00:29 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:00:29 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:00:29 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:00:29 user nova-compute[73121]:   </os>
Aug 15 02:00:29 user nova-compute[73121]:   <features>
Aug 15 02:00:29 user nova-compute[73121]:     <acpi/>
Aug 15 02:00:29 user nova-compute[73121]:     <apic/>
Aug 15 02:00:29 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:00:29 user nova-compute[73121]:   </features>
Aug 15 02:00:29 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:00:29 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:00:29 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:00:29 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:00:29 user nova-compute[73121]:   </clock>
Aug 15 02:00:29 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:00:29 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:00:29 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:00:29 user nova-compute[73121]:   </cpu>
Aug 15 02:00:29 user nova-compute[73121]:   <devices>
Aug 15 02:00:29 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:00:29 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:00:29 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk"/>
Aug 15 02:00:29 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:00:29 user nova-compute[73121]:     </disk>
Aug 15 02:00:29 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:00:29 user nova-compute[73121]:       <mac address="fa:16:3e:1b:ef:02"/>
Aug 15 02:00:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:29 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:00:29 user nova-compute[73121]:       <target dev="tapd3309b3f-6c"/>
Aug 15 02:00:29 user nova-compute[73121]:     </interface>
Aug 15 02:00:29 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:00:29 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/console.log" append="off"/>
Aug 15 02:00:29 user nova-compute[73121]:     </serial>
Aug 15 02:00:29 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:00:29 user nova-compute[73121]:     <video>
Aug 15 02:00:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:29 user nova-compute[73121]:     </video>
Aug 15 02:00:29 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:00:29 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:00:29 user nova-compute[73121]:     </rng>
Aug 15 02:00:29 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:00:29 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:00:29 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:00:29 user nova-compute[73121]:     </memballoon>
Aug 15 02:00:29 user nova-compute[73121]:   </devices>
Aug 15 02:00:29 user nova-compute[73121]: </domain>
Aug 15 02:00:29 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-227119013',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-227119013',id=1,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-03v2ficv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:20Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=ad8b33e3-c58c-4182-a43a-248f5f1face1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ef:02,bridge_name='br-int',has_traffic_filtering=True,id=d3309b3f-6cf7-4ab3-92df-54f35121ff91,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3309b3f-6c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG os_vif [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ef:02,bridge_name='br-int',has_traffic_filtering=True,id=d3309b3f-6cf7-4ab3-92df-54f35121ff91,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3309b3f-6c') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Created schema index Interface.name {{(pid=73121) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Created schema index Port.name {{(pid=73121) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Created schema index Bridge.name {{(pid=73121) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [POLLOUT] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.neutron [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating instance_info_cache with network_info: [{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:00:29 user nova-compute[73121]: INFO oslo.privsep.daemon [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpxp_y7cml/privsep.sock']
Aug 15 02:00:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Releasing lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance network_info: |[{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7798fefe-2bb5-4381-8a4d-27e2d5b3b8ac req-fc980283-abc7-4e97-a94d-39dc46e7e6e6 service nova] Acquired lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.neutron [req-7798fefe-2bb5-4381-8a4d-27e2d5b3b8ac req-fc980283-abc7-4e97-a94d-39dc46e7e6e6 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Refreshing network info cache for port 896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Start _get_guest_xml network_info=[{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:00:29 user sudo[82504]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpxp_y7cml/privsep.sock
Aug 15 02:00:29 user sudo[82504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 02:00:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-696601170',display_name='tempest-AttachVolumeTestJSON-server-696601170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-696601170',id=2,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrHjZP720UW0jo4iit8Pxgel5e+QfHyvMcWZQXiEzUPxi1x+UpLbvVaMujS5PIKUKWw85w6Ks98+VVNHxofUs5EqHpLoyaS82dHgB23+nlXLdzYmwP/5iI0jRjGfKXxQ==',key_name='tempest-keypair-65630828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-xc2jvcst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=2c215d73-ebab-4b74-b2a5-a4b5a0264e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.objects.instance [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Successfully created port: d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:00:29 user nova-compute[73121]:   <uuid>2c215d73-ebab-4b74-b2a5-a4b5a0264e89</uuid>
Aug 15 02:00:29 user nova-compute[73121]:   <name>instance-00000002</name>
Aug 15 02:00:29 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:00:29 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:00:29 user nova-compute[73121]:   <metadata>
Aug 15 02:00:29 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:00:29 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeTestJSON-server-696601170</nova:name>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:00:29</nova:creationTime>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:00:29 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:00:29 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:owner>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:user uuid="8c555808f8b84962b88920df9f029648">tempest-AttachVolumeTestJSON-1774938081-project-member</nova:user>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:project uuid="16eb9362b3cd4011b8c7bae927a6edd6">tempest-AttachVolumeTestJSON-1774938081</nova:project>
Aug 15 02:00:29 user nova-compute[73121]:       </nova:owner>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:00:29 user nova-compute[73121]:       <nova:ports>
Aug 15 02:00:29 user nova-compute[73121]:         <nova:port uuid="896acc02-dd7e-4464-be83-5a9774c03d22">
Aug 15 02:00:29 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 02:00:29 user nova-compute[73121]:         </nova:port>
Aug 15 02:00:29 user nova-compute[73121]:       </nova:ports>
Aug 15 02:00:29 user nova-compute[73121]:     </nova:instance>
Aug 15 02:00:29 user nova-compute[73121]:   </metadata>
Aug 15 02:00:29 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:00:29 user nova-compute[73121]:     <system>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="serial">2c215d73-ebab-4b74-b2a5-a4b5a0264e89</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="uuid">2c215d73-ebab-4b74-b2a5-a4b5a0264e89</entry>
Aug 15 02:00:29 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:00:29 user nova-compute[73121]:     </system>
Aug 15 02:00:29 user nova-compute[73121]:   </sysinfo>
Aug 15 02:00:29 user nova-compute[73121]:   <os>
Aug 15 02:00:29 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:00:29 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:00:29 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:00:29 user nova-compute[73121]:   </os>
Aug 15 02:00:29 user nova-compute[73121]:   <features>
Aug 15 02:00:29 user nova-compute[73121]:     <acpi/>
Aug 15 02:00:29 user nova-compute[73121]:     <apic/>
Aug 15 02:00:29 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:00:29 user nova-compute[73121]:   </features>
Aug 15 02:00:29 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:00:29 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:00:29 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:00:29 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:00:29 user nova-compute[73121]:   </clock>
Aug 15 02:00:29 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:00:29 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:00:29 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:00:29 user nova-compute[73121]:   </cpu>
Aug 15 02:00:29 user nova-compute[73121]:   <devices>
Aug 15 02:00:29 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:00:29 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:00:29 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk"/>
Aug 15 02:00:29 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:00:29 user nova-compute[73121]:     </disk>
Aug 15 02:00:29 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:00:29 user nova-compute[73121]:       <mac address="fa:16:3e:a5:cc:77"/>
Aug 15 02:00:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:29 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:00:29 user nova-compute[73121]:       <target dev="tap896acc02-dd"/>
Aug 15 02:00:29 user nova-compute[73121]:     </interface>
Aug 15 02:00:29 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:00:29 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/console.log" append="off"/>
Aug 15 02:00:29 user nova-compute[73121]:     </serial>
Aug 15 02:00:29 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:00:29 user nova-compute[73121]:     <video>
Aug 15 02:00:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:29 user nova-compute[73121]:     </video>
Aug 15 02:00:29 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:00:29 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:00:29 user nova-compute[73121]:     </rng>
Aug 15 02:00:29 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:00:29 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:00:29 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:00:29 user nova-compute[73121]:     </memballoon>
Aug 15 02:00:29 user nova-compute[73121]:   </devices>
Aug 15 02:00:29 user nova-compute[73121]: </domain>
Aug 15 02:00:29 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-696601170',display_name='tempest-AttachVolumeTestJSON-server-696601170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-696601170',id=2,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrHjZP720UW0jo4iit8Pxgel5e+QfHyvMcWZQXiEzUPxi1x+UpLbvVaMujS5PIKUKWw85w6Ks98+VVNHxofUs5EqHpLoyaS82dHgB23+nlXLdzYmwP/5iI0jRjGfKXxQ==',key_name='tempest-keypair-65630828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-xc2jvcst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=2c215d73-ebab-4b74-b2a5-a4b5a0264e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG os_vif [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:00:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:30 user nova-compute[73121]: DEBUG nova.network.neutron [req-7798fefe-2bb5-4381-8a4d-27e2d5b3b8ac req-fc980283-abc7-4e97-a94d-39dc46e7e6e6 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updated VIF entry in instance network info cache for port 896acc02-dd7e-4464-be83-5a9774c03d22. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:00:30 user nova-compute[73121]: DEBUG nova.network.neutron [req-7798fefe-2bb5-4381-8a4d-27e2d5b3b8ac req-fc980283-abc7-4e97-a94d-39dc46e7e6e6 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating instance_info_cache with network_info: [{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7798fefe-2bb5-4381-8a4d-27e2d5b3b8ac req-fc980283-abc7-4e97-a94d-39dc46e7e6e6 service nova] Releasing lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:31 user sudo[82504]: pam_unix(sudo:session): session closed for user root
Aug 15 02:00:31 user nova-compute[73121]: INFO oslo.privsep.daemon [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Spawned new privsep daemon via rootwrap
Aug 15 02:00:31 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 02:00:31 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 02:00:31 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 15 02:00:31 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82516
Aug 15 02:00:31 user nova-compute[73121]: WARNING oslo_privsep.priv_context [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] privsep daemon already running
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG nova.network.neutron [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Successfully updated port: 963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquired lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG nova.network.neutron [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-ac5a993a-2e5d-4f87-bb7a-cc0f9d9d5ede req-5083b45e-22fb-4ab2-a90d-0d25c00da14c service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received event network-changed-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-ac5a993a-2e5d-4f87-bb7a-cc0f9d9d5ede req-5083b45e-22fb-4ab2-a90d-0d25c00da14c service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Refreshing instance network info cache due to event network-changed-963ddb92-0719-440d-b59a-a485de0837f9. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ac5a993a-2e5d-4f87-bb7a-cc0f9d9d5ede req-5083b45e-22fb-4ab2-a90d-0d25c00da14c service nova] Acquiring lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap896acc02-dd, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap896acc02-dd, col_values=(('external_ids', {'iface-id': '896acc02-dd7e-4464-be83-5a9774c03d22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:cc:77', 'vm-uuid': '2c215d73-ebab-4b74-b2a5-a4b5a0264e89'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:31 user nova-compute[73121]: INFO os_vif [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd')
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3309b3f-6c, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3309b3f-6c, col_values=(('external_ids', {'iface-id': 'd3309b3f-6cf7-4ab3-92df-54f35121ff91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:ef:02', 'vm-uuid': 'ad8b33e3-c58c-4182-a43a-248f5f1face1'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:31 user nova-compute[73121]: INFO os_vif [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:ef:02,bridge_name='br-int',has_traffic_filtering=True,id=d3309b3f-6cf7-4ab3-92df-54f35121ff91,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3309b3f-6c')
Aug 15 02:00:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No VIF found with MAC fa:16:3e:a5:cc:77, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No VIF found with MAC fa:16:3e:1b:ef:02, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Successfully updated port: d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "refresh_cache-78cda252-7cca-412c-ac97-24fc375d32de" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquired lock "refresh_cache-78cda252-7cca-412c-ac97-24fc375d32de" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-414fe38c-c7b0-4d27-9527-f40d5b02f850 req-2f54b35e-f1fd-43ba-967d-8bfbdb8c78d8 service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received event network-changed-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-414fe38c-c7b0-4d27-9527-f40d5b02f850 req-2f54b35e-f1fd-43ba-967d-8bfbdb8c78d8 service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Refreshing instance network info cache due to event network-changed-d840486f-df2b-40b1-a01e-14471d669645. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-414fe38c-c7b0-4d27-9527-f40d5b02f850 req-2f54b35e-f1fd-43ba-967d-8bfbdb8c78d8 service nova] Acquiring lock "refresh_cache-78cda252-7cca-412c-ac97-24fc375d32de" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG nova.network.neutron [req-fd95945b-e096-49ef-86fa-87e12eb0d7ec req-340e0c6d-4b00-481b-a138-c9057d799153 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updated VIF entry in instance network info cache for port d3309b3f-6cf7-4ab3-92df-54f35121ff91. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG nova.network.neutron [req-fd95945b-e096-49ef-86fa-87e12eb0d7ec req-340e0c6d-4b00-481b-a138-c9057d799153 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updating instance_info_cache with network_info: [{"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fd95945b-e096-49ef-86fa-87e12eb0d7ec req-340e0c6d-4b00-481b-a138-c9057d799153 service nova] Releasing lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Updating instance_info_cache with network_info: [{"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Releasing lock "refresh_cache-78cda252-7cca-412c-ac97-24fc375d32de" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Instance network_info: |[{"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-414fe38c-c7b0-4d27-9527-f40d5b02f850 req-2f54b35e-f1fd-43ba-967d-8bfbdb8c78d8 service nova] Acquired lock "refresh_cache-78cda252-7cca-412c-ac97-24fc375d32de" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.network.neutron [req-414fe38c-c7b0-4d27-9527-f40d5b02f850 req-2f54b35e-f1fd-43ba-967d-8bfbdb8c78d8 service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Refreshing network info cache for port d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Start _get_guest_xml network_info=[{"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:00:33 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:33 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-40316936',display_name='tempest-DeleteServersTestJSON-server-40316936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-40316936',id=4,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df1cae4eab914ce5abe90d931e112c5c',ramdisk_id='',reservation_id='r-tptspjlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-679744656',owner_user_name='tempest-DeleteServersTestJSON-679744656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:26Z,user_data=None,user_id='47877ca691894793a44512cecf6218e5',uuid=78cda252-7cca-412c-ac97-24fc375d32de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Converting VIF {"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:7f:c5,bridge_name='br-int',has_traffic_filtering=True,id=d840486f-df2b-40b1-a01e-14471d669645,network=Network(6b564e69-edd3-4efd-8f15-a8ad7f029860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd840486f-df') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lazy-loading 'pci_devices' on Instance uuid 78cda252-7cca-412c-ac97-24fc375d32de {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:00:33 user nova-compute[73121]:   <uuid>78cda252-7cca-412c-ac97-24fc375d32de</uuid>
Aug 15 02:00:33 user nova-compute[73121]:   <name>instance-00000004</name>
Aug 15 02:00:33 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:00:33 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:00:33 user nova-compute[73121]:   <metadata>
Aug 15 02:00:33 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:00:33 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:00:33 user nova-compute[73121]:       <nova:name>tempest-DeleteServersTestJSON-server-40316936</nova:name>
Aug 15 02:00:33 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:00:33</nova:creationTime>
Aug 15 02:00:33 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:00:33 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:00:33 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:00:33 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:00:33 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:00:33 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:00:33 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:00:33 user nova-compute[73121]:       <nova:owner>
Aug 15 02:00:33 user nova-compute[73121]:         <nova:user uuid="47877ca691894793a44512cecf6218e5">tempest-DeleteServersTestJSON-679744656-project-member</nova:user>
Aug 15 02:00:33 user nova-compute[73121]:         <nova:project uuid="df1cae4eab914ce5abe90d931e112c5c">tempest-DeleteServersTestJSON-679744656</nova:project>
Aug 15 02:00:33 user nova-compute[73121]:       </nova:owner>
Aug 15 02:00:33 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:00:33 user nova-compute[73121]:       <nova:ports>
Aug 15 02:00:33 user nova-compute[73121]:         <nova:port uuid="d840486f-df2b-40b1-a01e-14471d669645">
Aug 15 02:00:33 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 02:00:33 user nova-compute[73121]:         </nova:port>
Aug 15 02:00:33 user nova-compute[73121]:       </nova:ports>
Aug 15 02:00:33 user nova-compute[73121]:     </nova:instance>
Aug 15 02:00:33 user nova-compute[73121]:   </metadata>
Aug 15 02:00:33 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:00:33 user nova-compute[73121]:     <system>
Aug 15 02:00:33 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:00:33 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:00:33 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:00:33 user nova-compute[73121]:       <entry name="serial">78cda252-7cca-412c-ac97-24fc375d32de</entry>
Aug 15 02:00:33 user nova-compute[73121]:       <entry name="uuid">78cda252-7cca-412c-ac97-24fc375d32de</entry>
Aug 15 02:00:33 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:00:33 user nova-compute[73121]:     </system>
Aug 15 02:00:33 user nova-compute[73121]:   </sysinfo>
Aug 15 02:00:33 user nova-compute[73121]:   <os>
Aug 15 02:00:33 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:00:33 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:00:33 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:00:33 user nova-compute[73121]:   </os>
Aug 15 02:00:33 user nova-compute[73121]:   <features>
Aug 15 02:00:33 user nova-compute[73121]:     <acpi/>
Aug 15 02:00:33 user nova-compute[73121]:     <apic/>
Aug 15 02:00:33 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:00:33 user nova-compute[73121]:   </features>
Aug 15 02:00:33 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:00:33 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:00:33 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:00:33 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:00:33 user nova-compute[73121]:   </clock>
Aug 15 02:00:33 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:00:33 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:00:33 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:00:33 user nova-compute[73121]:   </cpu>
Aug 15 02:00:33 user nova-compute[73121]:   <devices>
Aug 15 02:00:33 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:00:33 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:00:33 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk"/>
Aug 15 02:00:33 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:00:33 user nova-compute[73121]:     </disk>
Aug 15 02:00:33 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:00:33 user nova-compute[73121]:       <mac address="fa:16:3e:3f:7f:c5"/>
Aug 15 02:00:33 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:33 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:00:33 user nova-compute[73121]:       <target dev="tapd840486f-df"/>
Aug 15 02:00:33 user nova-compute[73121]:     </interface>
Aug 15 02:00:33 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:00:33 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/console.log" append="off"/>
Aug 15 02:00:33 user nova-compute[73121]:     </serial>
Aug 15 02:00:33 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:00:33 user nova-compute[73121]:     <video>
Aug 15 02:00:33 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:33 user nova-compute[73121]:     </video>
Aug 15 02:00:33 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:00:33 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:00:33 user nova-compute[73121]:     </rng>
Aug 15 02:00:33 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:00:33 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:00:33 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:00:33 user nova-compute[73121]:     </memballoon>
Aug 15 02:00:33 user nova-compute[73121]:   </devices>
Aug 15 02:00:33 user nova-compute[73121]: </domain>
Aug 15 02:00:33 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-40316936',display_name='tempest-DeleteServersTestJSON-server-40316936',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-40316936',id=4,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='df1cae4eab914ce5abe90d931e112c5c',ramdisk_id='',reservation_id='r-tptspjlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-679744656',owner_user_name='tempest-DeleteServersTestJSON-679744656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:26Z,user_data=None,user_id='47877ca691894793a44512cecf6218e5',uuid=78cda252-7cca-412c-ac97-24fc375d32de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Converting VIF {"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:7f:c5,bridge_name='br-int',has_traffic_filtering=True,id=d840486f-df2b-40b1-a01e-14471d669645,network=Network(6b564e69-edd3-4efd-8f15-a8ad7f029860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd840486f-df') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG os_vif [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:7f:c5,bridge_name='br-int',has_traffic_filtering=True,id=d840486f-df2b-40b1-a01e-14471d669645,network=Network(6b564e69-edd3-4efd-8f15-a8ad7f029860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd840486f-df') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd840486f-df, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd840486f-df, col_values=(('external_ids', {'iface-id': 'd840486f-df2b-40b1-a01e-14471d669645', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:7f:c5', 'vm-uuid': '78cda252-7cca-412c-ac97-24fc375d32de'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:33 user nova-compute[73121]: INFO os_vif [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:7f:c5,bridge_name='br-int',has_traffic_filtering=True,id=d840486f-df2b-40b1-a01e-14471d669645,network=Network(6b564e69-edd3-4efd-8f15-a8ad7f029860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd840486f-df')
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.network.neutron [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Updating instance_info_cache with network_info: [{"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Releasing lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Instance network_info: |[{"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ac5a993a-2e5d-4f87-bb7a-cc0f9d9d5ede req-5083b45e-22fb-4ab2-a90d-0d25c00da14c service nova] Acquired lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.network.neutron [req-ac5a993a-2e5d-4f87-bb7a-cc0f9d9d5ede req-5083b45e-22fb-4ab2-a90d-0d25c00da14c service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Refreshing network info cache for port 963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:00:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Start _get_guest_xml network_info=[{"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:00:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] No VIF found with MAC fa:16:3e:3f:7f:c5, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1403265403',display_name='tempest-ServersNegativeTestJSON-server-1403265403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1403265403',id=3,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='104f505852da4e74b4afddadf5b4a9a5',ramdisk_id='',reservation_id='r-1w8u20as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-68547960',owner_user_name='tempest-ServersNegativeTestJSON-68547960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:23Z,user_data=None,user_id='e4105e54b7264bb3aa05ceeccbf32277',uuid=4e04a498-4518-46c9-bc49-4d0d5d6aa054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converting VIF {"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:3c:bf,bridge_name='br-int',has_traffic_filtering=True,id=963ddb92-0719-440d-b59a-a485de0837f9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963ddb92-07') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.objects.instance [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e04a498-4518-46c9-bc49-4d0d5d6aa054 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:00:34 user nova-compute[73121]:   <uuid>4e04a498-4518-46c9-bc49-4d0d5d6aa054</uuid>
Aug 15 02:00:34 user nova-compute[73121]:   <name>instance-00000003</name>
Aug 15 02:00:34 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:00:34 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:00:34 user nova-compute[73121]:   <metadata>
Aug 15 02:00:34 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:00:34 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:00:34 user nova-compute[73121]:       <nova:name>tempest-ServersNegativeTestJSON-server-1403265403</nova:name>
Aug 15 02:00:34 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:00:34</nova:creationTime>
Aug 15 02:00:34 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:00:34 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:00:34 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:00:34 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:00:34 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:00:34 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:00:34 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:00:34 user nova-compute[73121]:       <nova:owner>
Aug 15 02:00:34 user nova-compute[73121]:         <nova:user uuid="e4105e54b7264bb3aa05ceeccbf32277">tempest-ServersNegativeTestJSON-68547960-project-member</nova:user>
Aug 15 02:00:34 user nova-compute[73121]:         <nova:project uuid="104f505852da4e74b4afddadf5b4a9a5">tempest-ServersNegativeTestJSON-68547960</nova:project>
Aug 15 02:00:34 user nova-compute[73121]:       </nova:owner>
Aug 15 02:00:34 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:00:34 user nova-compute[73121]:       <nova:ports>
Aug 15 02:00:34 user nova-compute[73121]:         <nova:port uuid="963ddb92-0719-440d-b59a-a485de0837f9">
Aug 15 02:00:34 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:00:34 user nova-compute[73121]:         </nova:port>
Aug 15 02:00:34 user nova-compute[73121]:       </nova:ports>
Aug 15 02:00:34 user nova-compute[73121]:     </nova:instance>
Aug 15 02:00:34 user nova-compute[73121]:   </metadata>
Aug 15 02:00:34 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:00:34 user nova-compute[73121]:     <system>
Aug 15 02:00:34 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:00:34 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:00:34 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:00:34 user nova-compute[73121]:       <entry name="serial">4e04a498-4518-46c9-bc49-4d0d5d6aa054</entry>
Aug 15 02:00:34 user nova-compute[73121]:       <entry name="uuid">4e04a498-4518-46c9-bc49-4d0d5d6aa054</entry>
Aug 15 02:00:34 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:00:34 user nova-compute[73121]:     </system>
Aug 15 02:00:34 user nova-compute[73121]:   </sysinfo>
Aug 15 02:00:34 user nova-compute[73121]:   <os>
Aug 15 02:00:34 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:00:34 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:00:34 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:00:34 user nova-compute[73121]:   </os>
Aug 15 02:00:34 user nova-compute[73121]:   <features>
Aug 15 02:00:34 user nova-compute[73121]:     <acpi/>
Aug 15 02:00:34 user nova-compute[73121]:     <apic/>
Aug 15 02:00:34 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:00:34 user nova-compute[73121]:   </features>
Aug 15 02:00:34 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:00:34 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:00:34 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:00:34 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:00:34 user nova-compute[73121]:   </clock>
Aug 15 02:00:34 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:00:34 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:00:34 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:00:34 user nova-compute[73121]:   </cpu>
Aug 15 02:00:34 user nova-compute[73121]:   <devices>
Aug 15 02:00:34 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:00:34 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:00:34 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk"/>
Aug 15 02:00:34 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:00:34 user nova-compute[73121]:     </disk>
Aug 15 02:00:34 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:00:34 user nova-compute[73121]:       <mac address="fa:16:3e:01:3c:bf"/>
Aug 15 02:00:34 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:34 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:00:34 user nova-compute[73121]:       <target dev="tap963ddb92-07"/>
Aug 15 02:00:34 user nova-compute[73121]:     </interface>
Aug 15 02:00:34 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:00:34 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/console.log" append="off"/>
Aug 15 02:00:34 user nova-compute[73121]:     </serial>
Aug 15 02:00:34 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:00:34 user nova-compute[73121]:     <video>
Aug 15 02:00:34 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:34 user nova-compute[73121]:     </video>
Aug 15 02:00:34 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:00:34 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:00:34 user nova-compute[73121]:     </rng>
Aug 15 02:00:34 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:00:34 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:00:34 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:00:34 user nova-compute[73121]:     </memballoon>
Aug 15 02:00:34 user nova-compute[73121]:   </devices>
Aug 15 02:00:34 user nova-compute[73121]: </domain>
Aug 15 02:00:34 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1403265403',display_name='tempest-ServersNegativeTestJSON-server-1403265403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1403265403',id=3,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='104f505852da4e74b4afddadf5b4a9a5',ramdisk_id='',reservation_id='r-1w8u20as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-68547960',owner_user_name='tempest-ServersNegativeTestJSON-68547960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:23Z,user_data=None,user_id='e4105e54b7264bb3aa05ceeccbf32277',uuid=4e04a498-4518-46c9-bc49-4d0d5d6aa054,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converting VIF {"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:3c:bf,bridge_name='br-int',has_traffic_filtering=True,id=963ddb92-0719-440d-b59a-a485de0837f9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963ddb92-07') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG os_vif [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:3c:bf,bridge_name='br-int',has_traffic_filtering=True,id=963ddb92-0719-440d-b59a-a485de0837f9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963ddb92-07') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap963ddb92-07, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap963ddb92-07, col_values=(('external_ids', {'iface-id': '963ddb92-0719-440d-b59a-a485de0837f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:3c:bf', 'vm-uuid': '4e04a498-4518-46c9-bc49-4d0d5d6aa054'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:34 user nova-compute[73121]: INFO os_vif [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:3c:bf,bridge_name='br-int',has_traffic_filtering=True,id=963ddb92-0719-440d-b59a-a485de0837f9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963ddb92-07')
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] No VIF found with MAC fa:16:3e:01:3c:bf, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:35 user nova-compute[73121]: DEBUG nova.network.neutron [req-414fe38c-c7b0-4d27-9527-f40d5b02f850 req-2f54b35e-f1fd-43ba-967d-8bfbdb8c78d8 service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Updated VIF entry in instance network info cache for port d840486f-df2b-40b1-a01e-14471d669645. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:00:35 user nova-compute[73121]: DEBUG nova.network.neutron [req-414fe38c-c7b0-4d27-9527-f40d5b02f850 req-2f54b35e-f1fd-43ba-967d-8bfbdb8c78d8 service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Updating instance_info_cache with network_info: [{"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-414fe38c-c7b0-4d27-9527-f40d5b02f850 req-2f54b35e-f1fd-43ba-967d-8bfbdb8c78d8 service nova] Releasing lock "refresh_cache-78cda252-7cca-412c-ac97-24fc375d32de" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:36 user nova-compute[73121]: DEBUG nova.network.neutron [req-ac5a993a-2e5d-4f87-bb7a-cc0f9d9d5ede req-5083b45e-22fb-4ab2-a90d-0d25c00da14c service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Updated VIF entry in instance network info cache for port 963ddb92-0719-440d-b59a-a485de0837f9. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:00:36 user nova-compute[73121]: DEBUG nova.network.neutron [req-ac5a993a-2e5d-4f87-bb7a-cc0f9d9d5ede req-5083b45e-22fb-4ab2-a90d-0d25c00da14c service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Updating instance_info_cache with network_info: [{"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ac5a993a-2e5d-4f87-bb7a-cc0f9d9d5ede req-5083b45e-22fb-4ab2-a90d-0d25c00da14c service nova] Releasing lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064838.4713604, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:00:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] VM Resumed (Lifecycle Event)
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:00:38 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance spawned successfully.
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064838.4760222, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:00:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] VM Started (Lifecycle Event)
Aug 15 02:00:38 user nova-compute[73121]: INFO nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Took 17.47 seconds to spawn the instance on the hypervisor.
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:00:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:00:38 user nova-compute[73121]: INFO nova.compute.manager [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Took 18.31 seconds to build instance.
Aug 15 02:00:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3507a125-c3a3-4d55-a3b1-46253def5455 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.464s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064840.1600413, ad8b33e3-c58c-4182-a43a-248f5f1face1 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] VM Resumed (Lifecycle Event)
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Instance spawned successfully.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064840.1651492, ad8b33e3-c58c-4182-a43a-248f5f1face1 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] VM Started (Lifecycle Event)
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Took 20.36 seconds to spawn the instance on the hypervisor.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064840.3984804, 78cda252-7cca-412c-ac97-24fc375d32de => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] VM Resumed (Lifecycle Event)
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Instance spawned successfully.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Instance spawned successfully.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064840.4003024, 78cda252-7cca-412c-ac97-24fc375d32de => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] VM Started (Lifecycle Event)
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Took 14.20 seconds to spawn the instance on the hypervisor.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Took 21.39 seconds to build instance.
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064840.4315555, 4e04a498-4518-46c9-bc49-4d0d5d6aa054 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] VM Resumed (Lifecycle Event)
Aug 15 02:00:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c0f26a8-56cf-4b9d-a7f2-93152cbdd6fc tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.601s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Took 17.47 seconds to spawn the instance on the hypervisor.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064840.4316366, 4e04a498-4518-46c9-bc49-4d0d5d6aa054 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] VM Started (Lifecycle Event)
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Took 14.94 seconds to build instance.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a1f2d5fb-14dc-4ac3-93a0-741abe0538c7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.052s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:40 user nova-compute[73121]: INFO nova.compute.manager [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Took 18.28 seconds to build instance.
Aug 15 02:00:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-37ccd4cf-5c42-455a-86e7-1be4aa6a5a3e tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.500s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-d1129709-79ce-41e4-9262-2f24f7941250 req-fa6534f6-c335-4168-8fcc-29fa9a73d70e service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received event network-vif-plugged-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d1129709-79ce-41e4-9262-2f24f7941250 req-fa6534f6-c335-4168-8fcc-29fa9a73d70e service nova] Acquiring lock "78cda252-7cca-412c-ac97-24fc375d32de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d1129709-79ce-41e4-9262-2f24f7941250 req-fa6534f6-c335-4168-8fcc-29fa9a73d70e service nova] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d1129709-79ce-41e4-9262-2f24f7941250 req-fa6534f6-c335-4168-8fcc-29fa9a73d70e service nova] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-d1129709-79ce-41e4-9262-2f24f7941250 req-fa6534f6-c335-4168-8fcc-29fa9a73d70e service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] No waiting events found dispatching network-vif-plugged-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:00:47 user nova-compute[73121]: WARNING nova.compute.manager [req-d1129709-79ce-41e4-9262-2f24f7941250 req-fa6534f6-c335-4168-8fcc-29fa9a73d70e service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received unexpected event network-vif-plugged-d840486f-df2b-40b1-a01e-14471d669645 for instance with vm_state active and task_state None.
Aug 15 02:00:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:00:49 user nova-compute[73121]: INFO nova.compute.claims [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Claim successful on node user
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-7f48f5c5-82f1-429d-a331-944b73612f7e req-369d7d64-28c0-4153-8044-bc461129fa88 service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received event network-vif-plugged-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7f48f5c5-82f1-429d-a331-944b73612f7e req-369d7d64-28c0-4153-8044-bc461129fa88 service nova] Acquiring lock "78cda252-7cca-412c-ac97-24fc375d32de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7f48f5c5-82f1-429d-a331-944b73612f7e req-369d7d64-28c0-4153-8044-bc461129fa88 service nova] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7f48f5c5-82f1-429d-a331-944b73612f7e req-369d7d64-28c0-4153-8044-bc461129fa88 service nova] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-7f48f5c5-82f1-429d-a331-944b73612f7e req-369d7d64-28c0-4153-8044-bc461129fa88 service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] No waiting events found dispatching network-vif-plugged-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:00:49 user nova-compute[73121]: WARNING nova.compute.manager [req-7f48f5c5-82f1-429d-a331-944b73612f7e req-369d7d64-28c0-4153-8044-bc461129fa88 service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received unexpected event network-vif-plugged-d840486f-df2b-40b1-a01e-14471d669645 for instance with vm_state active and task_state None.
Aug 15 02:00:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:00:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 15 02:00:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG nova.policy [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b01588a70d544b7297f29dc5dc14dfc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecf865dc7f4b4d48a30216bb550aeee3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:00:50 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Creating image(s)
Aug 15 02:00:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "/opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "/opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "7a9a26e591f195431b5efc9512b292ac7f3b16aa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "7a9a26e591f195431b5efc9512b292ac7f3b16aa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa.part --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG nova.virt.images [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] 1504a059-e5fa-4095-90ae-d13cf3efea37 was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa.part /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:00:51 user nova-compute[73121]: INFO nova.compute.claims [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Claim successful on node user
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa.part /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa.converted" returned: 0 in 0.412s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa.converted --force-share --output=json" returned: 0 in 0.266s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "7a9a26e591f195431b5efc9512b292ac7f3b16aa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.654s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "7a9a26e591f195431b5efc9512b292ac7f3b16aa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "7a9a26e591f195431b5efc9512b292ac7f3b16aa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa --force-share --output=json" returned: 0 in 0.228s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa,backing_fmt=raw /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa,backing_fmt=raw /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk 1073741824" returned: 0 in 0.066s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "7a9a26e591f195431b5efc9512b292ac7f3b16aa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.133s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.446s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:00:52 user nova-compute[73121]: INFO nova.compute.claims [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Claim successful on node user
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:00:52 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.network.neutron [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Successfully created port: 896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa --force-share --output=json" returned: 0 in 0.239s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:00:52 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Creating image(s)
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.policy [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7967084f3b954a739fef6956a789cbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728a7726790042c99e4bd53c2967ee96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Cannot resize image /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.objects.instance [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lazy-loading 'migration_context' on Instance uuid d7d7ea92-e89a-43cb-8e41-b983fa788244 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Ensure instance console log exists: /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.710s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.258s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk 1073741824" returned: 0 in 0.095s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:53 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Successfully updated port: 896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.policy [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae827293f6984ad78b5361b415b78a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd8c0c79b374093bfdd9fa70538769f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "refresh_cache-d7d7ea92-e89a-43cb-8e41-b983fa788244" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquired lock "refresh_cache-d7d7ea92-e89a-43cb-8e41-b983fa788244" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:00:53 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Creating image(s)
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "/opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "/opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.247s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Checking if we can resize image /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-0328bd9e-29e6-44e0-a5af-2ffa75a9d427 req-a668c2b2-e485-402c-a846-0abb7cb71461 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received event network-changed-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-0328bd9e-29e6-44e0-a5af-2ffa75a9d427 req-a668c2b2-e485-402c-a846-0abb7cb71461 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Refreshing instance network info cache due to event network-changed-896e7b3e-1b88-4a65-bdc2-06a5045a43f6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0328bd9e-29e6-44e0-a5af-2ffa75a9d427 req-a668c2b2-e485-402c-a846-0abb7cb71461 service nova] Acquiring lock "refresh_cache-d7d7ea92-e89a-43cb-8e41-b983fa788244" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Cannot resize image /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.objects.instance [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lazy-loading 'migration_context' on Instance uuid 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Ensure instance console log exists: /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.240s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.254s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk 1073741824" returned: 0 in 0.056s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:00:54 user nova-compute[73121]: INFO nova.compute.claims [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Claim successful on node user
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Updating instance_info_cache with network_info: [{"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Successfully created port: 1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Releasing lock "refresh_cache-d7d7ea92-e89a-43cb-8e41-b983fa788244" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Instance network_info: |[{"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0328bd9e-29e6-44e0-a5af-2ffa75a9d427 req-a668c2b2-e485-402c-a846-0abb7cb71461 service nova] Acquired lock "refresh_cache-d7d7ea92-e89a-43cb-8e41-b983fa788244" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.network.neutron [req-0328bd9e-29e6-44e0-a5af-2ffa75a9d427 req-a668c2b2-e485-402c-a846-0abb7cb71461 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Refreshing network info cache for port 896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Start _get_guest_xml network_info=[{"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T02:00:39Z,direct_url=<?>,disk_format='qcow2',id=1504a059-e5fa-4095-90ae-d13cf3efea37,min_disk=0,min_ram=0,name='',owner='87e6e9d43148465cb08ff1be07f63f27',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T02:00:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'device_name': '/dev/sda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'scsi', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '1504a059-e5fa-4095-90ae-d13cf3efea37'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:00:54 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:54 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Cannot resize image /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lazy-loading 'migration_context' on Instance uuid 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Ensure instance console log exists: /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T02:00:39Z,direct_url=<?>,disk_format='qcow2',id=1504a059-e5fa-4095-90ae-d13cf3efea37,min_disk=0,min_ram=0,name='',owner='87e6e9d43148465cb08ff1be07f63f27',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T02:00:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-373463171',display_name='tempest-AttachSCSIVolumeTestJSON-server-373463171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-373463171',id=5,image_ref='1504a059-e5fa-4095-90ae-d13cf3efea37',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8JQuwZ9/OPqrYML4nhtr7q3kY6HosKDlFWo1msv12FcG0eDtbagC6d66CW1TiMkqrAUqaDGugqhztuaMLfk1/dnh4Awm14XfVyMsux/NzJrVRDOFhLlN4fdGlixi7x3A==',key_name='tempest-keypair-451795057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecf865dc7f4b4d48a30216bb550aeee3',ramdisk_id='',reservation_id='r-f3mtig76',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1504a059-e5fa-4095-90ae-d13cf3efea37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1428843306',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1428843306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b01588a70d544b7297f29dc5dc14dfc2',uuid=d7d7ea92-e89a-43cb-8e41-b983fa788244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Converting VIF {"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:33:47,bridge_name='br-int',has_traffic_filtering=True,id=896e7b3e-1b88-4a65-bdc2-06a5045a43f6,network=Network(8b0ca458-0ccd-42de-8db3-ee5a90c1aeae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896e7b3e-1b') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.objects.instance [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lazy-loading 'pci_devices' on Instance uuid d7d7ea92-e89a-43cb-8e41-b983fa788244 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:00:54 user nova-compute[73121]:   <uuid>d7d7ea92-e89a-43cb-8e41-b983fa788244</uuid>
Aug 15 02:00:54 user nova-compute[73121]:   <name>instance-00000005</name>
Aug 15 02:00:54 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:00:54 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:00:54 user nova-compute[73121]:   <metadata>
Aug 15 02:00:54 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:00:54 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:00:54 user nova-compute[73121]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-373463171</nova:name>
Aug 15 02:00:54 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:00:54</nova:creationTime>
Aug 15 02:00:54 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:00:54 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:00:54 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:00:54 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:00:54 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:00:54 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:00:54 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:00:54 user nova-compute[73121]:       <nova:owner>
Aug 15 02:00:54 user nova-compute[73121]:         <nova:user uuid="b01588a70d544b7297f29dc5dc14dfc2">tempest-AttachSCSIVolumeTestJSON-1428843306-project-member</nova:user>
Aug 15 02:00:54 user nova-compute[73121]:         <nova:project uuid="ecf865dc7f4b4d48a30216bb550aeee3">tempest-AttachSCSIVolumeTestJSON-1428843306</nova:project>
Aug 15 02:00:54 user nova-compute[73121]:       </nova:owner>
Aug 15 02:00:54 user nova-compute[73121]:       <nova:root type="image" uuid="1504a059-e5fa-4095-90ae-d13cf3efea37"/>
Aug 15 02:00:54 user nova-compute[73121]:       <nova:ports>
Aug 15 02:00:54 user nova-compute[73121]:         <nova:port uuid="896e7b3e-1b88-4a65-bdc2-06a5045a43f6">
Aug 15 02:00:54 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 02:00:54 user nova-compute[73121]:         </nova:port>
Aug 15 02:00:54 user nova-compute[73121]:       </nova:ports>
Aug 15 02:00:54 user nova-compute[73121]:     </nova:instance>
Aug 15 02:00:54 user nova-compute[73121]:   </metadata>
Aug 15 02:00:54 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:00:54 user nova-compute[73121]:     <system>
Aug 15 02:00:54 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:00:54 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:00:54 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:00:54 user nova-compute[73121]:       <entry name="serial">d7d7ea92-e89a-43cb-8e41-b983fa788244</entry>
Aug 15 02:00:54 user nova-compute[73121]:       <entry name="uuid">d7d7ea92-e89a-43cb-8e41-b983fa788244</entry>
Aug 15 02:00:54 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:00:54 user nova-compute[73121]:     </system>
Aug 15 02:00:54 user nova-compute[73121]:   </sysinfo>
Aug 15 02:00:54 user nova-compute[73121]:   <os>
Aug 15 02:00:54 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:00:54 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:00:54 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:00:54 user nova-compute[73121]:   </os>
Aug 15 02:00:54 user nova-compute[73121]:   <features>
Aug 15 02:00:54 user nova-compute[73121]:     <acpi/>
Aug 15 02:00:54 user nova-compute[73121]:     <apic/>
Aug 15 02:00:54 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:00:54 user nova-compute[73121]:   </features>
Aug 15 02:00:54 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:00:54 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:00:54 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:00:54 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:00:54 user nova-compute[73121]:   </clock>
Aug 15 02:00:54 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:00:54 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:00:54 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:00:54 user nova-compute[73121]:   </cpu>
Aug 15 02:00:54 user nova-compute[73121]:   <devices>
Aug 15 02:00:54 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:00:54 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:00:54 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk"/>
Aug 15 02:00:54 user nova-compute[73121]:       <target dev="sda" bus="scsi"/>
Aug 15 02:00:54 user nova-compute[73121]:       <address type="drive" controller="0" unit="0"/>
Aug 15 02:00:54 user nova-compute[73121]:     </disk>
Aug 15 02:00:54 user nova-compute[73121]:     <disk type="file" device="cdrom">
Aug 15 02:00:54 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 02:00:54 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk.config"/>
Aug 15 02:00:54 user nova-compute[73121]:       <target dev="sdb" bus="scsi"/>
Aug 15 02:00:54 user nova-compute[73121]:       <address type="drive" controller="0" unit="1"/>
Aug 15 02:00:54 user nova-compute[73121]:     </disk>
Aug 15 02:00:54 user nova-compute[73121]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 15 02:00:54 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:00:54 user nova-compute[73121]:       <mac address="fa:16:3e:97:33:47"/>
Aug 15 02:00:54 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:54 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:00:54 user nova-compute[73121]:       <target dev="tap896e7b3e-1b"/>
Aug 15 02:00:54 user nova-compute[73121]:     </interface>
Aug 15 02:00:54 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:00:54 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/console.log" append="off"/>
Aug 15 02:00:54 user nova-compute[73121]:     </serial>
Aug 15 02:00:54 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:00:54 user nova-compute[73121]:     <video>
Aug 15 02:00:54 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:54 user nova-compute[73121]:     </video>
Aug 15 02:00:54 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:00:54 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:00:54 user nova-compute[73121]:     </rng>
Aug 15 02:00:54 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:00:54 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:00:54 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:00:54 user nova-compute[73121]:     </memballoon>
Aug 15 02:00:54 user nova-compute[73121]:   </devices>
Aug 15 02:00:54 user nova-compute[73121]: </domain>
Aug 15 02:00:54 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-373463171',display_name='tempest-AttachSCSIVolumeTestJSON-server-373463171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-373463171',id=5,image_ref='1504a059-e5fa-4095-90ae-d13cf3efea37',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8JQuwZ9/OPqrYML4nhtr7q3kY6HosKDlFWo1msv12FcG0eDtbagC6d66CW1TiMkqrAUqaDGugqhztuaMLfk1/dnh4Awm14XfVyMsux/NzJrVRDOFhLlN4fdGlixi7x3A==',key_name='tempest-keypair-451795057',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ecf865dc7f4b4d48a30216bb550aeee3',ramdisk_id='',reservation_id='r-f3mtig76',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1504a059-e5fa-4095-90ae-d13cf3efea37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1428843306',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1428843306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b01588a70d544b7297f29dc5dc14dfc2',uuid=d7d7ea92-e89a-43cb-8e41-b983fa788244,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Converting VIF {"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:33:47,bridge_name='br-int',has_traffic_filtering=True,id=896e7b3e-1b88-4a65-bdc2-06a5045a43f6,network=Network(8b0ca458-0ccd-42de-8db3-ee5a90c1aeae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896e7b3e-1b') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG os_vif [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:33:47,bridge_name='br-int',has_traffic_filtering=True,id=896e7b3e-1b88-4a65-bdc2-06a5045a43f6,network=Network(8b0ca458-0ccd-42de-8db3-ee5a90c1aeae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896e7b3e-1b') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap896e7b3e-1b, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap896e7b3e-1b, col_values=(('external_ids', {'iface-id': '896e7b3e-1b88-4a65-bdc2-06a5045a43f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:33:47', 'vm-uuid': 'd7d7ea92-e89a-43cb-8e41-b983fa788244'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:54 user nova-compute[73121]: INFO os_vif [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:33:47,bridge_name='br-int',has_traffic_filtering=True,id=896e7b3e-1b88-4a65-bdc2-06a5045a43f6,network=Network(8b0ca458-0ccd-42de-8db3-ee5a90c1aeae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896e7b3e-1b')
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] No BDM found with device name sda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] No VIF found with MAC fa:16:3e:97:33:47, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:00:54 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Using config drive
Aug 15 02:00:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.672s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Successfully created port: 699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:00:55 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:00:55 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Creating image(s)
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquiring lock "/opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "/opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "/opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.policy [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20c819edaf054b01b840814dcb08302a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8824b9c281ad4e97922c93bc3560f9f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:00:55 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Creating config drive at /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk.config
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph62_ye80 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-0328bd9e-29e6-44e0-a5af-2ffa75a9d427 req-a668c2b2-e485-402c-a846-0abb7cb71461 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Updated VIF entry in instance network info cache for port 896e7b3e-1b88-4a65-bdc2-06a5045a43f6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-0328bd9e-29e6-44e0-a5af-2ffa75a9d427 req-a668c2b2-e485-402c-a846-0abb7cb71461 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Updating instance_info_cache with network_info: [{"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmph62_ye80" returned: 0 in 0.063s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0328bd9e-29e6-44e0-a5af-2ffa75a9d427 req-a668c2b2-e485-402c-a846-0abb7cb71461 service nova] Releasing lock "refresh_cache-d7d7ea92-e89a-43cb-8e41-b983fa788244" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Successfully updated port: 1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.219s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquired lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-e07ec5c7-c523-4a19-9dd9-1f9fb1734d78 req-bfdae3fc-89cf-4c73-a5b1-2a4449c79ce9 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-changed-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-e07ec5c7-c523-4a19-9dd9-1f9fb1734d78 req-bfdae3fc-89cf-4c73-a5b1-2a4449c79ce9 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Refreshing instance network info cache due to event network-changed-1c8be17e-3242-49dd-b0b0-cd0834cf845c. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e07ec5c7-c523-4a19-9dd9-1f9fb1734d78 req-bfdae3fc-89cf-4c73-a5b1-2a4449c79ce9 service nova] Acquiring lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.287s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk 1073741824" returned: 0 in 0.056s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Successfully updated port: 699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquired lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updating instance_info_cache with network_info: [{"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Releasing lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Instance network_info: |[{"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e07ec5c7-c523-4a19-9dd9-1f9fb1734d78 req-bfdae3fc-89cf-4c73-a5b1-2a4449c79ce9 service nova] Acquired lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.neutron [req-e07ec5c7-c523-4a19-9dd9-1f9fb1734d78 req-bfdae3fc-89cf-4c73-a5b1-2a4449c79ce9 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Refreshing network info cache for port 1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Start _get_guest_xml network_info=[{"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-fd58c9a9-d2b1-4665-b782-a4a59fafc01e req-fe3d9a11-c38d-429d-b9ff-93bc448b8510 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received event network-changed-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-fd58c9a9-d2b1-4665-b782-a4a59fafc01e req-fe3d9a11-c38d-429d-b9ff-93bc448b8510 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Refreshing instance network info cache due to event network-changed-699f8498-cccf-4a68-ba6c-366e8ee2a959. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fd58c9a9-d2b1-4665-b782-a4a59fafc01e req-fe3d9a11-c38d-429d-b9ff-93bc448b8510 service nova] Acquiring lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Cannot resize image /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lazy-loading 'migration_context' on Instance uuid 66e5ded4-d25e-443f-b000-df3b693555dd {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Ensure instance console log exists: /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:00:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:00:56 user nova-compute[73121]: INFO nova.compute.claims [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Claim successful on node user
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1318082023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1318082023',id=6,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaNdyYz27xk+rfspm0CM27aYjNNYrCrxWXHlEOIfv3Q6WatZXVBNwBJYMUI8ec6jJvv3xvpG28G35Inoo6iygE/loMQdezawYx8ddyYXrAFA1EYbDFxyVvB9BTw1fLZcA==',key_name='tempest-keypair-479875827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='728a7726790042c99e4bd53c2967ee96',ramdisk_id='',reservation_id='r-16w40iyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2030671207',owner_user_name='tempest-TaggedAttachmentsTest-2030671207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7967084f3b954a739fef6956a789cbad',uuid=793cddda-b586-4601-9f22-47938c9ccfb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converting VIF {"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6b:67,bridge_name='br-int',has_traffic_filtering=True,id=1c8be17e-3242-49dd-b0b0-cd0834cf845c,network=Network(68649b4e-dcff-4f71-948e-9c2bf72d7b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8be17e-32') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lazy-loading 'pci_devices' on Instance uuid 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Successfully created port: 64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:00:56 user nova-compute[73121]:   <uuid>793cddda-b586-4601-9f22-47938c9ccfb4</uuid>
Aug 15 02:00:56 user nova-compute[73121]:   <name>instance-00000006</name>
Aug 15 02:00:56 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:00:56 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:00:56 user nova-compute[73121]:   <metadata>
Aug 15 02:00:56 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:00:56 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:00:56 user nova-compute[73121]:       <nova:name>tempest-device-tagging-server-1318082023</nova:name>
Aug 15 02:00:56 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:00:56</nova:creationTime>
Aug 15 02:00:56 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:00:56 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:00:56 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:00:56 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:00:56 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:00:56 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:00:56 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:00:56 user nova-compute[73121]:       <nova:owner>
Aug 15 02:00:56 user nova-compute[73121]:         <nova:user uuid="7967084f3b954a739fef6956a789cbad">tempest-TaggedAttachmentsTest-2030671207-project-member</nova:user>
Aug 15 02:00:56 user nova-compute[73121]:         <nova:project uuid="728a7726790042c99e4bd53c2967ee96">tempest-TaggedAttachmentsTest-2030671207</nova:project>
Aug 15 02:00:56 user nova-compute[73121]:       </nova:owner>
Aug 15 02:00:56 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:00:56 user nova-compute[73121]:       <nova:ports>
Aug 15 02:00:56 user nova-compute[73121]:         <nova:port uuid="1c8be17e-3242-49dd-b0b0-cd0834cf845c">
Aug 15 02:00:56 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 02:00:56 user nova-compute[73121]:         </nova:port>
Aug 15 02:00:56 user nova-compute[73121]:       </nova:ports>
Aug 15 02:00:56 user nova-compute[73121]:     </nova:instance>
Aug 15 02:00:56 user nova-compute[73121]:   </metadata>
Aug 15 02:00:56 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:00:56 user nova-compute[73121]:     <system>
Aug 15 02:00:56 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:00:56 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:00:56 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:00:56 user nova-compute[73121]:       <entry name="serial">793cddda-b586-4601-9f22-47938c9ccfb4</entry>
Aug 15 02:00:56 user nova-compute[73121]:       <entry name="uuid">793cddda-b586-4601-9f22-47938c9ccfb4</entry>
Aug 15 02:00:56 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:00:56 user nova-compute[73121]:     </system>
Aug 15 02:00:56 user nova-compute[73121]:   </sysinfo>
Aug 15 02:00:56 user nova-compute[73121]:   <os>
Aug 15 02:00:56 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:00:56 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:00:56 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:00:56 user nova-compute[73121]:   </os>
Aug 15 02:00:56 user nova-compute[73121]:   <features>
Aug 15 02:00:56 user nova-compute[73121]:     <acpi/>
Aug 15 02:00:56 user nova-compute[73121]:     <apic/>
Aug 15 02:00:56 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:00:56 user nova-compute[73121]:   </features>
Aug 15 02:00:56 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:00:56 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:00:56 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:00:56 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:00:56 user nova-compute[73121]:   </clock>
Aug 15 02:00:56 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:00:56 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:00:56 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:00:56 user nova-compute[73121]:   </cpu>
Aug 15 02:00:56 user nova-compute[73121]:   <devices>
Aug 15 02:00:56 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:00:56 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:00:56 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk"/>
Aug 15 02:00:56 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:00:56 user nova-compute[73121]:     </disk>
Aug 15 02:00:56 user nova-compute[73121]:     <disk type="file" device="cdrom">
Aug 15 02:00:56 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 02:00:56 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk.config"/>
Aug 15 02:00:56 user nova-compute[73121]:       <target dev="hda" bus="ide"/>
Aug 15 02:00:56 user nova-compute[73121]:     </disk>
Aug 15 02:00:56 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:00:56 user nova-compute[73121]:       <mac address="fa:16:3e:a4:6b:67"/>
Aug 15 02:00:56 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:56 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:00:56 user nova-compute[73121]:       <target dev="tap1c8be17e-32"/>
Aug 15 02:00:56 user nova-compute[73121]:     </interface>
Aug 15 02:00:56 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:00:56 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/console.log" append="off"/>
Aug 15 02:00:56 user nova-compute[73121]:     </serial>
Aug 15 02:00:56 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:00:56 user nova-compute[73121]:     <video>
Aug 15 02:00:56 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:56 user nova-compute[73121]:     </video>
Aug 15 02:00:56 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:00:56 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:00:56 user nova-compute[73121]:     </rng>
Aug 15 02:00:56 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:00:56 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:00:56 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:00:56 user nova-compute[73121]:     </memballoon>
Aug 15 02:00:56 user nova-compute[73121]:   </devices>
Aug 15 02:00:56 user nova-compute[73121]: </domain>
Aug 15 02:00:56 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1318082023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1318082023',id=6,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaNdyYz27xk+rfspm0CM27aYjNNYrCrxWXHlEOIfv3Q6WatZXVBNwBJYMUI8ec6jJvv3xvpG28G35Inoo6iygE/loMQdezawYx8ddyYXrAFA1EYbDFxyVvB9BTw1fLZcA==',key_name='tempest-keypair-479875827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='728a7726790042c99e4bd53c2967ee96',ramdisk_id='',reservation_id='r-16w40iyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2030671207',owner_user_name='tempest-TaggedAttachmentsTest-2030671207-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7967084f3b954a739fef6956a789cbad',uuid=793cddda-b586-4601-9f22-47938c9ccfb4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converting VIF {"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6b:67,bridge_name='br-int',has_traffic_filtering=True,id=1c8be17e-3242-49dd-b0b0-cd0834cf845c,network=Network(68649b4e-dcff-4f71-948e-9c2bf72d7b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8be17e-32') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG os_vif [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6b:67,bridge_name='br-int',has_traffic_filtering=True,id=1c8be17e-3242-49dd-b0b0-cd0834cf845c,network=Network(68649b4e-dcff-4f71-948e-9c2bf72d7b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8be17e-32') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c8be17e-32, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1c8be17e-32, col_values=(('external_ids', {'iface-id': '1c8be17e-3242-49dd-b0b0-cd0834cf845c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:6b:67', 'vm-uuid': '793cddda-b586-4601-9f22-47938c9ccfb4'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:56 user nova-compute[73121]: INFO os_vif [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:6b:67,bridge_name='br-int',has_traffic_filtering=True,id=1c8be17e-3242-49dd-b0b0-cd0834cf845c,network=Network(68649b4e-dcff-4f71-948e-9c2bf72d7b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8be17e-32')
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] No BDM found with device name hda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] No VIF found with MAC fa:16:3e:a4:6b:67, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:00:56 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Using config drive
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Updating instance_info_cache with network_info: [{"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Releasing lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Instance network_info: |[{"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fd58c9a9-d2b1-4665-b782-a4a59fafc01e req-fe3d9a11-c38d-429d-b9ff-93bc448b8510 service nova] Acquired lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.network.neutron [req-fd58c9a9-d2b1-4665-b782-a4a59fafc01e req-fe3d9a11-c38d-429d-b9ff-93bc448b8510 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Refreshing network info cache for port 699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:00:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Start _get_guest_xml network_info=[{"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:00:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-611731004',display_name='tempest-VolumesAdminNegativeTest-server-611731004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-611731004',id=7,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwk5Jcd4LPk4JuNz+l9GPpuJXCXvO7nIztHcmq7yqgApWE/NAEXvtbV+u38Ix36XCp+CtYgZuaEB5W4PqNmZvxZOHYZ431RUselnnQ9I9T38+DiHBJDBMv5d2OFntyhyQ==',key_name='tempest-keypair-346632083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfd8c0c79b374093bfdd9fa70538769f',ramdisk_id='',reservation_id='r-mo6qzbrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-465693716',owner_user_name='tempest-VolumesAdminNegativeTest-465693716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae827293f6984ad78b5361b415b78a27',uuid=1cd60a34-caf3-42b0-811d-ac93f5bc2e71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converting VIF {"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5a:f2,bridge_name='br-int',has_traffic_filtering=True,id=699f8498-cccf-4a68-ba6c-366e8ee2a959,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699f8498-cc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Creating config drive at /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk.config
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsbabjbne {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:00:57 user nova-compute[73121]:   <uuid>1cd60a34-caf3-42b0-811d-ac93f5bc2e71</uuid>
Aug 15 02:00:57 user nova-compute[73121]:   <name>instance-00000007</name>
Aug 15 02:00:57 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:00:57 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:00:57 user nova-compute[73121]:   <metadata>
Aug 15 02:00:57 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:00:57 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:00:57 user nova-compute[73121]:       <nova:name>tempest-VolumesAdminNegativeTest-server-611731004</nova:name>
Aug 15 02:00:57 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:00:56</nova:creationTime>
Aug 15 02:00:57 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:00:57 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:00:57 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:00:57 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:00:57 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:00:57 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:00:57 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:00:57 user nova-compute[73121]:       <nova:owner>
Aug 15 02:00:57 user nova-compute[73121]:         <nova:user uuid="ae827293f6984ad78b5361b415b78a27">tempest-VolumesAdminNegativeTest-465693716-project-member</nova:user>
Aug 15 02:00:57 user nova-compute[73121]:         <nova:project uuid="cfd8c0c79b374093bfdd9fa70538769f">tempest-VolumesAdminNegativeTest-465693716</nova:project>
Aug 15 02:00:57 user nova-compute[73121]:       </nova:owner>
Aug 15 02:00:57 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:00:57 user nova-compute[73121]:       <nova:ports>
Aug 15 02:00:57 user nova-compute[73121]:         <nova:port uuid="699f8498-cccf-4a68-ba6c-366e8ee2a959">
Aug 15 02:00:57 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:00:57 user nova-compute[73121]:         </nova:port>
Aug 15 02:00:57 user nova-compute[73121]:       </nova:ports>
Aug 15 02:00:57 user nova-compute[73121]:     </nova:instance>
Aug 15 02:00:57 user nova-compute[73121]:   </metadata>
Aug 15 02:00:57 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:00:57 user nova-compute[73121]:     <system>
Aug 15 02:00:57 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:00:57 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:00:57 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:00:57 user nova-compute[73121]:       <entry name="serial">1cd60a34-caf3-42b0-811d-ac93f5bc2e71</entry>
Aug 15 02:00:57 user nova-compute[73121]:       <entry name="uuid">1cd60a34-caf3-42b0-811d-ac93f5bc2e71</entry>
Aug 15 02:00:57 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:00:57 user nova-compute[73121]:     </system>
Aug 15 02:00:57 user nova-compute[73121]:   </sysinfo>
Aug 15 02:00:57 user nova-compute[73121]:   <os>
Aug 15 02:00:57 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:00:57 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:00:57 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:00:57 user nova-compute[73121]:   </os>
Aug 15 02:00:57 user nova-compute[73121]:   <features>
Aug 15 02:00:57 user nova-compute[73121]:     <acpi/>
Aug 15 02:00:57 user nova-compute[73121]:     <apic/>
Aug 15 02:00:57 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:00:57 user nova-compute[73121]:   </features>
Aug 15 02:00:57 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:00:57 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:00:57 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:00:57 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:00:57 user nova-compute[73121]:   </clock>
Aug 15 02:00:57 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:00:57 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:00:57 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:00:57 user nova-compute[73121]:   </cpu>
Aug 15 02:00:57 user nova-compute[73121]:   <devices>
Aug 15 02:00:57 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:00:57 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:00:57 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk"/>
Aug 15 02:00:57 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:00:57 user nova-compute[73121]:     </disk>
Aug 15 02:00:57 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:00:57 user nova-compute[73121]:       <mac address="fa:16:3e:9e:5a:f2"/>
Aug 15 02:00:57 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:57 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:00:57 user nova-compute[73121]:       <target dev="tap699f8498-cc"/>
Aug 15 02:00:57 user nova-compute[73121]:     </interface>
Aug 15 02:00:57 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:00:57 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/console.log" append="off"/>
Aug 15 02:00:57 user nova-compute[73121]:     </serial>
Aug 15 02:00:57 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:00:57 user nova-compute[73121]:     <video>
Aug 15 02:00:57 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:57 user nova-compute[73121]:     </video>
Aug 15 02:00:57 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:00:57 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:00:57 user nova-compute[73121]:     </rng>
Aug 15 02:00:57 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:00:57 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:00:57 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:00:57 user nova-compute[73121]:     </memballoon>
Aug 15 02:00:57 user nova-compute[73121]:   </devices>
Aug 15 02:00:57 user nova-compute[73121]: </domain>
Aug 15 02:00:57 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-611731004',display_name='tempest-VolumesAdminNegativeTest-server-611731004',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-611731004',id=7,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwk5Jcd4LPk4JuNz+l9GPpuJXCXvO7nIztHcmq7yqgApWE/NAEXvtbV+u38Ix36XCp+CtYgZuaEB5W4PqNmZvxZOHYZ431RUselnnQ9I9T38+DiHBJDBMv5d2OFntyhyQ==',key_name='tempest-keypair-346632083',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfd8c0c79b374093bfdd9fa70538769f',ramdisk_id='',reservation_id='r-mo6qzbrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-465693716',owner_user_name='tempest-VolumesAdminNegativeTest-465693716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae827293f6984ad78b5361b415b78a27',uuid=1cd60a34-caf3-42b0-811d-ac93f5bc2e71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converting VIF {"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5a:f2,bridge_name='br-int',has_traffic_filtering=True,id=699f8498-cccf-4a68-ba6c-366e8ee2a959,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699f8498-cc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG os_vif [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5a:f2,bridge_name='br-int',has_traffic_filtering=True,id=699f8498-cccf-4a68-ba6c-366e8ee2a959,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699f8498-cc') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpsbabjbne" returned: 0 in 0.078s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:00:57 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap699f8498-cc, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap699f8498-cc, col_values=(('external_ids', {'iface-id': '699f8498-cccf-4a68-ba6c-366e8ee2a959', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:5a:f2', 'vm-uuid': '1cd60a34-caf3-42b0-811d-ac93f5bc2e71'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: INFO os_vif [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5a:f2,bridge_name='br-int',has_traffic_filtering=True,id=699f8498-cccf-4a68-ba6c-366e8ee2a959,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699f8498-cc')
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] No VIF found with MAC fa:16:3e:9e:5a:f2, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.network.neutron [req-e07ec5c7-c523-4a19-9dd9-1f9fb1734d78 req-bfdae3fc-89cf-4c73-a5b1-2a4449c79ce9 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updated VIF entry in instance network info cache for port 1c8be17e-3242-49dd-b0b0-cd0834cf845c. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.network.neutron [req-e07ec5c7-c523-4a19-9dd9-1f9fb1734d78 req-bfdae3fc-89cf-4c73-a5b1-2a4449c79ce9 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updating instance_info_cache with network_info: [{"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:00:57 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Creating image(s)
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "/opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "/opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "/opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.policy [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4474100b0c64d0bb6df27da43111622', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd59eb976a212498c879959542db2def4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e07ec5c7-c523-4a19-9dd9-1f9fb1734d78 req-bfdae3fc-89cf-4c73-a5b1-2a4449c79ce9 service nova] Releasing lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.network.neutron [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Successfully updated port: 64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquiring lock "refresh_cache-66e5ded4-d25e-443f-b000-df3b693555dd" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquired lock "refresh_cache-66e5ded4-d25e-443f-b000-df3b693555dd" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.network.neutron [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk 1073741824" returned: 0 in 0.060s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-3458d374-3a98-4afe-8819-b1def0590585 req-5b52492e-d59c-4ba0-9bb9-b7f06bc94a2b service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received event network-changed-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-3458d374-3a98-4afe-8819-b1def0590585 req-5b52492e-d59c-4ba0-9bb9-b7f06bc94a2b service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Refreshing instance network info cache due to event network-changed-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:00:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3458d374-3a98-4afe-8819-b1def0590585 req-5b52492e-d59c-4ba0-9bb9-b7f06bc94a2b service nova] Acquiring lock "refresh_cache-66e5ded4-d25e-443f-b000-df3b693555dd" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Checking if we can resize image /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.neutron [req-fd58c9a9-d2b1-4665-b782-a4a59fafc01e req-fe3d9a11-c38d-429d-b9ff-93bc448b8510 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Updated VIF entry in instance network info cache for port 699f8498-cccf-4a68-ba6c-366e8ee2a959. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.neutron [req-fd58c9a9-d2b1-4665-b782-a4a59fafc01e req-fe3d9a11-c38d-429d-b9ff-93bc448b8510 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Updating instance_info_cache with network_info: [{"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fd58c9a9-d2b1-4665-b782-a4a59fafc01e req-fe3d9a11-c38d-429d-b9ff-93bc448b8510 service nova] Releasing lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.neutron [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Cannot resize image /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lazy-loading 'migration_context' on Instance uuid 03db2b8d-c678-4763-a87c-93e001ed9605 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Ensure instance console log exists: /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Successfully created port: 0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.neutron [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Updating instance_info_cache with network_info: [{"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Releasing lock "refresh_cache-66e5ded4-d25e-443f-b000-df3b693555dd" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Instance network_info: |[{"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3458d374-3a98-4afe-8819-b1def0590585 req-5b52492e-d59c-4ba0-9bb9-b7f06bc94a2b service nova] Acquired lock "refresh_cache-66e5ded4-d25e-443f-b000-df3b693555dd" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.neutron [req-3458d374-3a98-4afe-8819-b1def0590585 req-5b52492e-d59c-4ba0-9bb9-b7f06bc94a2b service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Refreshing network info cache for port 64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Start _get_guest_xml network_info=[{"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:00:58 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:58 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-714254737',display_name='tempest-VolumesAssistedSnapshotsTest-server-714254737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-714254737',id=8,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvqjDpFW1DYKIyoWcTWrUcH8jwnFbqX4Ou4e86sQMvrnmeBEw5GX+seawa5VuJJGBwx82NwTvi8jHtqhOxENpqNTnox7ce+/U58Hsd9vT3KVHoRkIM1tWlTBu+c8Lgn6w==',key_name='tempest-keypair-817842808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8824b9c281ad4e97922c93bc3560f9f4',ramdisk_id='',reservation_id='r-94ggw7ri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-313424460',owner_user_name='tempest-VolumesAssistedSnapshotsTest-313424460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c819edaf054b01b840814dcb08302a',uuid=66e5ded4-d25e-443f-b000-df3b693555dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Converting VIF {"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:81,bridge_name='br-int',has_traffic_filtering=True,id=64ea77e9-d4fe-49e3-adae-2a4a0284b0c1,network=Network(d26d9068-15ea-4caa-9497-c02ca16530a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ea77e9-d4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lazy-loading 'pci_devices' on Instance uuid 66e5ded4-d25e-443f-b000-df3b693555dd {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:00:58 user nova-compute[73121]:   <uuid>66e5ded4-d25e-443f-b000-df3b693555dd</uuid>
Aug 15 02:00:58 user nova-compute[73121]:   <name>instance-00000008</name>
Aug 15 02:00:58 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:00:58 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:00:58 user nova-compute[73121]:   <metadata>
Aug 15 02:00:58 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:00:58 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:00:58 user nova-compute[73121]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-714254737</nova:name>
Aug 15 02:00:58 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:00:58</nova:creationTime>
Aug 15 02:00:58 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:00:58 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:00:58 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:00:58 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:00:58 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:00:58 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:00:58 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:00:58 user nova-compute[73121]:       <nova:owner>
Aug 15 02:00:58 user nova-compute[73121]:         <nova:user uuid="20c819edaf054b01b840814dcb08302a">tempest-VolumesAssistedSnapshotsTest-313424460-project-member</nova:user>
Aug 15 02:00:58 user nova-compute[73121]:         <nova:project uuid="8824b9c281ad4e97922c93bc3560f9f4">tempest-VolumesAssistedSnapshotsTest-313424460</nova:project>
Aug 15 02:00:58 user nova-compute[73121]:       </nova:owner>
Aug 15 02:00:58 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:00:58 user nova-compute[73121]:       <nova:ports>
Aug 15 02:00:58 user nova-compute[73121]:         <nova:port uuid="64ea77e9-d4fe-49e3-adae-2a4a0284b0c1">
Aug 15 02:00:58 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 02:00:58 user nova-compute[73121]:         </nova:port>
Aug 15 02:00:58 user nova-compute[73121]:       </nova:ports>
Aug 15 02:00:58 user nova-compute[73121]:     </nova:instance>
Aug 15 02:00:58 user nova-compute[73121]:   </metadata>
Aug 15 02:00:58 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:00:58 user nova-compute[73121]:     <system>
Aug 15 02:00:58 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:00:58 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:00:58 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:00:58 user nova-compute[73121]:       <entry name="serial">66e5ded4-d25e-443f-b000-df3b693555dd</entry>
Aug 15 02:00:58 user nova-compute[73121]:       <entry name="uuid">66e5ded4-d25e-443f-b000-df3b693555dd</entry>
Aug 15 02:00:58 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:00:58 user nova-compute[73121]:     </system>
Aug 15 02:00:58 user nova-compute[73121]:   </sysinfo>
Aug 15 02:00:58 user nova-compute[73121]:   <os>
Aug 15 02:00:58 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:00:58 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:00:58 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:00:58 user nova-compute[73121]:   </os>
Aug 15 02:00:58 user nova-compute[73121]:   <features>
Aug 15 02:00:58 user nova-compute[73121]:     <acpi/>
Aug 15 02:00:58 user nova-compute[73121]:     <apic/>
Aug 15 02:00:58 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:00:58 user nova-compute[73121]:   </features>
Aug 15 02:00:58 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:00:58 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:00:58 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:00:58 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:00:58 user nova-compute[73121]:   </clock>
Aug 15 02:00:58 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:00:58 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:00:58 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:00:58 user nova-compute[73121]:   </cpu>
Aug 15 02:00:58 user nova-compute[73121]:   <devices>
Aug 15 02:00:58 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:00:58 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:00:58 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk"/>
Aug 15 02:00:58 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:00:58 user nova-compute[73121]:     </disk>
Aug 15 02:00:58 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:00:58 user nova-compute[73121]:       <mac address="fa:16:3e:09:04:81"/>
Aug 15 02:00:58 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:58 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:00:58 user nova-compute[73121]:       <target dev="tap64ea77e9-d4"/>
Aug 15 02:00:58 user nova-compute[73121]:     </interface>
Aug 15 02:00:58 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:00:58 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/console.log" append="off"/>
Aug 15 02:00:58 user nova-compute[73121]:     </serial>
Aug 15 02:00:58 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:00:58 user nova-compute[73121]:     <video>
Aug 15 02:00:58 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:58 user nova-compute[73121]:     </video>
Aug 15 02:00:58 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:00:58 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:00:58 user nova-compute[73121]:     </rng>
Aug 15 02:00:58 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:00:58 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:00:58 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:00:58 user nova-compute[73121]:     </memballoon>
Aug 15 02:00:58 user nova-compute[73121]:   </devices>
Aug 15 02:00:58 user nova-compute[73121]: </domain>
Aug 15 02:00:58 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-714254737',display_name='tempest-VolumesAssistedSnapshotsTest-server-714254737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-714254737',id=8,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvqjDpFW1DYKIyoWcTWrUcH8jwnFbqX4Ou4e86sQMvrnmeBEw5GX+seawa5VuJJGBwx82NwTvi8jHtqhOxENpqNTnox7ce+/U58Hsd9vT3KVHoRkIM1tWlTBu+c8Lgn6w==',key_name='tempest-keypair-817842808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8824b9c281ad4e97922c93bc3560f9f4',ramdisk_id='',reservation_id='r-94ggw7ri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-313424460',owner_user_name='tempest-VolumesAssistedSnapshotsTest-313424460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c819edaf054b01b840814dcb08302a',uuid=66e5ded4-d25e-443f-b000-df3b693555dd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Converting VIF {"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:81,bridge_name='br-int',has_traffic_filtering=True,id=64ea77e9-d4fe-49e3-adae-2a4a0284b0c1,network=Network(d26d9068-15ea-4caa-9497-c02ca16530a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ea77e9-d4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG os_vif [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:81,bridge_name='br-int',has_traffic_filtering=True,id=64ea77e9-d4fe-49e3-adae-2a4a0284b0c1,network=Network(d26d9068-15ea-4caa-9497-c02ca16530a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ea77e9-d4') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64ea77e9-d4, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64ea77e9-d4, col_values=(('external_ids', {'iface-id': '64ea77e9-d4fe-49e3-adae-2a4a0284b0c1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:04:81', 'vm-uuid': '66e5ded4-d25e-443f-b000-df3b693555dd'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:00:58 user nova-compute[73121]: INFO os_vif [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:04:81,bridge_name='br-int',has_traffic_filtering=True,id=64ea77e9-d4fe-49e3-adae-2a4a0284b0c1,network=Network(d26d9068-15ea-4caa-9497-c02ca16530a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ea77e9-d4')
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:00:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] No VIF found with MAC fa:16:3e:09:04:81, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-3458d374-3a98-4afe-8819-b1def0590585 req-5b52492e-d59c-4ba0-9bb9-b7f06bc94a2b service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Updated VIF entry in instance network info cache for port 64ea77e9-d4fe-49e3-adae-2a4a0284b0c1. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-3458d374-3a98-4afe-8819-b1def0590585 req-5b52492e-d59c-4ba0-9bb9-b7f06bc94a2b service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Updating instance_info_cache with network_info: [{"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3458d374-3a98-4afe-8819-b1def0590585 req-5b52492e-d59c-4ba0-9bb9-b7f06bc94a2b service nova] Releasing lock "refresh_cache-66e5ded4-d25e-443f-b000-df3b693555dd" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Successfully updated port: 0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "refresh_cache-03db2b8d-c678-4763-a87c-93e001ed9605" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquired lock "refresh_cache-03db2b8d-c678-4763-a87c-93e001ed9605" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-8ba28775-88c1-4dc7-a659-8c401398a80f req-2d0759fc-b1d9-48f4-9316-9b29cbb5ef33 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received event network-changed-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-8ba28775-88c1-4dc7-a659-8c401398a80f req-2d0759fc-b1d9-48f4-9316-9b29cbb5ef33 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Refreshing instance network info cache due to event network-changed-0dcc5fbd-cacb-44ff-8dd1-db427fa919af. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8ba28775-88c1-4dc7-a659-8c401398a80f req-2d0759fc-b1d9-48f4-9316-9b29cbb5ef33 service nova] Acquiring lock "refresh_cache-03db2b8d-c678-4763-a87c-93e001ed9605" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Updating instance_info_cache with network_info: [{"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Releasing lock "refresh_cache-03db2b8d-c678-4763-a87c-93e001ed9605" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Instance network_info: |[{"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8ba28775-88c1-4dc7-a659-8c401398a80f req-2d0759fc-b1d9-48f4-9316-9b29cbb5ef33 service nova] Acquired lock "refresh_cache-03db2b8d-c678-4763-a87c-93e001ed9605" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-8ba28775-88c1-4dc7-a659-8c401398a80f req-2d0759fc-b1d9-48f4-9316-9b29cbb5ef33 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Refreshing network info cache for port 0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Start _get_guest_xml network_info=[{"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:00:59 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:59 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1075617605',display_name='tempest-TestVolumeSwap-server-1075617605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1075617605',id=9,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Df4J3+W6G8ZRIE24xz1PuwB5/59WhTgzvMGX2QBdprZnVd8yvdKUV9UOrKqQK8bIM9aE68MSeeMIFNlrfKObFpwJohc/sOtg58jfFWR3rjmH66qEXvQ8uCNcZe9zo3g==',key_name='tempest-keypair-1127225729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59eb976a212498c879959542db2def4',ramdisk_id='',reservation_id='r-evkma1pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1598085296',owner_user_name='tempest-TestVolumeSwap-1598085296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4474100b0c64d0bb6df27da43111622',uuid=03db2b8d-c678-4763-a87c-93e001ed9605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Converting VIF {"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:8e:db,bridge_name='br-int',has_traffic_filtering=True,id=0dcc5fbd-cacb-44ff-8dd1-db427fa919af,network=Network(1ad2e9c5-3b66-4f47-9fee-7b957599eb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcc5fbd-ca') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lazy-loading 'pci_devices' on Instance uuid 03db2b8d-c678-4763-a87c-93e001ed9605 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:00:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:00:59 user nova-compute[73121]:   <uuid>03db2b8d-c678-4763-a87c-93e001ed9605</uuid>
Aug 15 02:00:59 user nova-compute[73121]:   <name>instance-00000009</name>
Aug 15 02:00:59 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:00:59 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:00:59 user nova-compute[73121]:   <metadata>
Aug 15 02:00:59 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:00:59 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:00:59 user nova-compute[73121]:       <nova:name>tempest-TestVolumeSwap-server-1075617605</nova:name>
Aug 15 02:00:59 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:00:59</nova:creationTime>
Aug 15 02:00:59 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:00:59 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:00:59 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:00:59 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:00:59 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:00:59 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:00:59 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:00:59 user nova-compute[73121]:       <nova:owner>
Aug 15 02:00:59 user nova-compute[73121]:         <nova:user uuid="e4474100b0c64d0bb6df27da43111622">tempest-TestVolumeSwap-1598085296-project-member</nova:user>
Aug 15 02:00:59 user nova-compute[73121]:         <nova:project uuid="d59eb976a212498c879959542db2def4">tempest-TestVolumeSwap-1598085296</nova:project>
Aug 15 02:00:59 user nova-compute[73121]:       </nova:owner>
Aug 15 02:00:59 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:00:59 user nova-compute[73121]:       <nova:ports>
Aug 15 02:00:59 user nova-compute[73121]:         <nova:port uuid="0dcc5fbd-cacb-44ff-8dd1-db427fa919af">
Aug 15 02:00:59 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 02:00:59 user nova-compute[73121]:         </nova:port>
Aug 15 02:00:59 user nova-compute[73121]:       </nova:ports>
Aug 15 02:00:59 user nova-compute[73121]:     </nova:instance>
Aug 15 02:00:59 user nova-compute[73121]:   </metadata>
Aug 15 02:00:59 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:00:59 user nova-compute[73121]:     <system>
Aug 15 02:00:59 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:00:59 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:00:59 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:00:59 user nova-compute[73121]:       <entry name="serial">03db2b8d-c678-4763-a87c-93e001ed9605</entry>
Aug 15 02:00:59 user nova-compute[73121]:       <entry name="uuid">03db2b8d-c678-4763-a87c-93e001ed9605</entry>
Aug 15 02:00:59 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:00:59 user nova-compute[73121]:     </system>
Aug 15 02:00:59 user nova-compute[73121]:   </sysinfo>
Aug 15 02:00:59 user nova-compute[73121]:   <os>
Aug 15 02:00:59 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:00:59 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:00:59 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:00:59 user nova-compute[73121]:   </os>
Aug 15 02:00:59 user nova-compute[73121]:   <features>
Aug 15 02:00:59 user nova-compute[73121]:     <acpi/>
Aug 15 02:00:59 user nova-compute[73121]:     <apic/>
Aug 15 02:00:59 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:00:59 user nova-compute[73121]:   </features>
Aug 15 02:00:59 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:00:59 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:00:59 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:00:59 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:00:59 user nova-compute[73121]:   </clock>
Aug 15 02:00:59 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:00:59 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:00:59 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:00:59 user nova-compute[73121]:   </cpu>
Aug 15 02:00:59 user nova-compute[73121]:   <devices>
Aug 15 02:00:59 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:00:59 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:00:59 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk"/>
Aug 15 02:00:59 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:00:59 user nova-compute[73121]:     </disk>
Aug 15 02:00:59 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:00:59 user nova-compute[73121]:       <mac address="fa:16:3e:70:8e:db"/>
Aug 15 02:00:59 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:59 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:00:59 user nova-compute[73121]:       <target dev="tap0dcc5fbd-ca"/>
Aug 15 02:00:59 user nova-compute[73121]:     </interface>
Aug 15 02:00:59 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:00:59 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/console.log" append="off"/>
Aug 15 02:00:59 user nova-compute[73121]:     </serial>
Aug 15 02:00:59 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:00:59 user nova-compute[73121]:     <video>
Aug 15 02:00:59 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:00:59 user nova-compute[73121]:     </video>
Aug 15 02:00:59 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:00:59 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:00:59 user nova-compute[73121]:     </rng>
Aug 15 02:00:59 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:00:59 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:00:59 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:00:59 user nova-compute[73121]:     </memballoon>
Aug 15 02:00:59 user nova-compute[73121]:   </devices>
Aug 15 02:00:59 user nova-compute[73121]: </domain>
Aug 15 02:00:59 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1075617605',display_name='tempest-TestVolumeSwap-server-1075617605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1075617605',id=9,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Df4J3+W6G8ZRIE24xz1PuwB5/59WhTgzvMGX2QBdprZnVd8yvdKUV9UOrKqQK8bIM9aE68MSeeMIFNlrfKObFpwJohc/sOtg58jfFWR3rjmH66qEXvQ8uCNcZe9zo3g==',key_name='tempest-keypair-1127225729',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d59eb976a212498c879959542db2def4',ramdisk_id='',reservation_id='r-evkma1pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1598085296',owner_user_name='tempest-TestVolumeSwap-1598085296-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:00:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4474100b0c64d0bb6df27da43111622',uuid=03db2b8d-c678-4763-a87c-93e001ed9605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Converting VIF {"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:8e:db,bridge_name='br-int',has_traffic_filtering=True,id=0dcc5fbd-cacb-44ff-8dd1-db427fa919af,network=Network(1ad2e9c5-3b66-4f47-9fee-7b957599eb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcc5fbd-ca') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG os_vif [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:8e:db,bridge_name='br-int',has_traffic_filtering=True,id=0dcc5fbd-cacb-44ff-8dd1-db427fa919af,network=Network(1ad2e9c5-3b66-4f47-9fee-7b957599eb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcc5fbd-ca') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dcc5fbd-ca, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0dcc5fbd-ca, col_values=(('external_ids', {'iface-id': '0dcc5fbd-cacb-44ff-8dd1-db427fa919af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:8e:db', 'vm-uuid': '03db2b8d-c678-4763-a87c-93e001ed9605'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:00 user nova-compute[73121]: INFO os_vif [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:8e:db,bridge_name='br-int',has_traffic_filtering=True,id=0dcc5fbd-cacb-44ff-8dd1-db427fa919af,network=Network(1ad2e9c5-3b66-4f47-9fee-7b957599eb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcc5fbd-ca')
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] No VIF found with MAC fa:16:3e:70:8e:db, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.network.neutron [req-8ba28775-88c1-4dc7-a659-8c401398a80f req-2d0759fc-b1d9-48f4-9316-9b29cbb5ef33 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Updated VIF entry in instance network info cache for port 0dcc5fbd-cacb-44ff-8dd1-db427fa919af. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.network.neutron [req-8ba28775-88c1-4dc7-a659-8c401398a80f req-2d0759fc-b1d9-48f4-9316-9b29cbb5ef33 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Updating instance_info_cache with network_info: [{"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8ba28775-88c1-4dc7-a659-8c401398a80f req-2d0759fc-b1d9-48f4-9316-9b29cbb5ef33 service nova] Releasing lock "refresh_cache-03db2b8d-c678-4763-a87c-93e001ed9605" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064860.7334838, d7d7ea92-e89a-43cb-8e41-b983fa788244 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:00 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] VM Resumed (Lifecycle Event)
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Instance spawned successfully.
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:00 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064860.738846, d7d7ea92-e89a-43cb-8e41-b983fa788244 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:00 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] VM Started (Lifecycle Event)
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:00 user nova-compute[73121]: INFO nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Took 10.71 seconds to spawn the instance on the hypervisor.
Aug 15 02:01:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:00 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: INFO nova.compute.manager [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Took 11.98 seconds to build instance.
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-85c8d7b3-3ecc-49f2-ab38-8556d6550e5f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.213s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-c961f3ba-0d36-414c-b596-71531a05de77 req-edc197c6-88f1-4040-b744-a62bdb8d6af6 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c961f3ba-0d36-414c-b596-71531a05de77 req-edc197c6-88f1-4040-b744-a62bdb8d6af6 service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c961f3ba-0d36-414c-b596-71531a05de77 req-edc197c6-88f1-4040-b744-a62bdb8d6af6 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c961f3ba-0d36-414c-b596-71531a05de77 req-edc197c6-88f1-4040-b744-a62bdb8d6af6 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-c961f3ba-0d36-414c-b596-71531a05de77 req-edc197c6-88f1-4040-b744-a62bdb8d6af6 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:03 user nova-compute[73121]: WARNING nova.compute.manager [req-c961f3ba-0d36-414c-b596-71531a05de77 req-edc197c6-88f1-4040-b744-a62bdb8d6af6 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state active and task_state None.
Aug 15 02:01:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:05 user nova-compute[73121]: WARNING nova.compute.manager [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state active and task_state None.
Aug 15 02:01:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received event network-vif-plugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] Acquiring lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] No waiting events found dispatching network-vif-plugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:05 user nova-compute[73121]: WARNING nova.compute.manager [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received unexpected event network-vif-plugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 for instance with vm_state active and task_state None.
Aug 15 02:01:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received event network-vif-plugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] Acquiring lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] No waiting events found dispatching network-vif-plugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:05 user nova-compute[73121]: WARNING nova.compute.manager [req-00dcfedc-1a23-4935-906f-63748ab621c4 req-1cd15338-d94d-42be-8efa-36269598dfc4 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received unexpected event network-vif-plugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 for instance with vm_state active and task_state None.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064866.2438667, 793cddda-b586-4601-9f22-47938c9ccfb4 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] VM Resumed (Lifecycle Event)
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Instance spawned successfully.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064866.2440906, 793cddda-b586-4601-9f22-47938c9ccfb4 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] VM Started (Lifecycle Event)
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Instance spawned successfully.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Instance spawned successfully.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Took 13.77 seconds to spawn the instance on the hypervisor.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064866.3945928, 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] VM Resumed (Lifecycle Event)
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Took 15.46 seconds to build instance.
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Instance spawned successfully.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Took 9.31 seconds to spawn the instance on the hypervisor.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb218ce8-05da-40db-ab4e-d2fde6a0c6dc tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.702s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064866.3947551, 03db2b8d-c678-4763-a87c-93e001ed9605 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] VM Resumed (Lifecycle Event)
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Took 13.24 seconds to spawn the instance on the hypervisor.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Took 11.34 seconds to spawn the instance on the hypervisor.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064866.3982096, 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] VM Started (Lifecycle Event)
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Took 15.08 seconds to build instance.
Aug 15 02:01:06 user nova-compute[73121]: INFO nova.compute.manager [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Took 10.50 seconds to build instance.
Aug 15 02:01:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a9d00b3f-7cf9-4b76-9f0c-ffea177570c4 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.342s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f806d536-9772-4b48-9c57-0898b9492edc tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.663s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064866.3997447, 03db2b8d-c678-4763-a87c-93e001ed9605 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] VM Started (Lifecycle Event)
Aug 15 02:01:07 user nova-compute[73121]: INFO nova.compute.manager [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Took 12.75 seconds to build instance.
Aug 15 02:01:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1813140c-32e0-4cd0-a64b-29f80a9e528c tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.909s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064866.5554836, 66e5ded4-d25e-443f-b000-df3b693555dd => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] VM Resumed (Lifecycle Event)
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064866.55568, 66e5ded4-d25e-443f-b000-df3b693555dd => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] VM Started (Lifecycle Event)
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid ad8b33e3-c58c-4182-a43a-248f5f1face1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updating instance_info_cache with network_info: [{"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-56104112-9c7a-418f-bc06-9daabd795057 req-98f3a17a-56c2-4a98-ae56-4008484a69aa service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received event network-vif-plugged-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-56104112-9c7a-418f-bc06-9daabd795057 req-98f3a17a-56c2-4a98-ae56-4008484a69aa service nova] Acquiring lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-56104112-9c7a-418f-bc06-9daabd795057 req-98f3a17a-56c2-4a98-ae56-4008484a69aa service nova] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-56104112-9c7a-418f-bc06-9daabd795057 req-98f3a17a-56c2-4a98-ae56-4008484a69aa service nova] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-56104112-9c7a-418f-bc06-9daabd795057 req-98f3a17a-56c2-4a98-ae56-4008484a69aa service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] No waiting events found dispatching network-vif-plugged-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:11 user nova-compute[73121]: WARNING nova.compute.manager [req-56104112-9c7a-418f-bc06-9daabd795057 req-98f3a17a-56c2-4a98-ae56-4008484a69aa service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received unexpected event network-vif-plugged-963ddb92-0719-440d-b59a-a485de0837f9 for instance with vm_state active and task_state None.
Aug 15 02:01:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-eb66bd28-f4a3-46be-a594-ddf941bf627b req-339036d9-7e08-4513-a765-589de0840917 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received event network-vif-plugged-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-eb66bd28-f4a3-46be-a594-ddf941bf627b req-339036d9-7e08-4513-a765-589de0840917 service nova] Acquiring lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-eb66bd28-f4a3-46be-a594-ddf941bf627b req-339036d9-7e08-4513-a765-589de0840917 service nova] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-eb66bd28-f4a3-46be-a594-ddf941bf627b req-339036d9-7e08-4513-a765-589de0840917 service nova] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-eb66bd28-f4a3-46be-a594-ddf941bf627b req-339036d9-7e08-4513-a765-589de0840917 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] No waiting events found dispatching network-vif-plugged-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:13 user nova-compute[73121]: WARNING nova.compute.manager [req-eb66bd28-f4a3-46be-a594-ddf941bf627b req-339036d9-7e08-4513-a765-589de0840917 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received unexpected event network-vif-plugged-963ddb92-0719-440d-b59a-a485de0837f9 for instance with vm_state active and task_state None.
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:15 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:01:15 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7694MB free_disk=25.84511947631836GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 4e04a498-4518-46c9-bc49-4d0d5d6aa054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 78cda252-7cca-412c-ac97-24fc375d32de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7d7ea92-e89a-43cb-8e41-b983fa788244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 793cddda-b586-4601-9f22-47938c9ccfb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 66e5ded4-d25e-443f-b000-df3b693555dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 03db2b8d-c678-4763-a87c-93e001ed9605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:01:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:01:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:01:17 user nova-compute[73121]: INFO nova.compute.claims [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Claim successful on node user
Aug 15 02:01:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:01:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:01:18 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:01:18 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:01:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.637s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:01:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:01:18 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:01:18 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:01:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:01:18 user nova-compute[73121]: INFO nova.virt.block_device [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Booting with volume c84c4d82-7f25-4940-bf81-f97ec0247a32 at /dev/vda
Aug 15 02:01:18 user nova-compute[73121]: DEBUG nova.policy [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4e0a6842bb14afda109782b1e26eaa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a213fca0e8144873a2a412a9348d4d20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:01:18 user nova-compute[73121]: DEBUG os_brick.utils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:01:18 user nova-compute[73121]: INFO oslo.privsep.daemon [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmprq1r056_/privsep.sock']
Aug 15 02:01:18 user sudo[84040]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmprq1r056_/privsep.sock
Aug 15 02:01:18 user sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 02:01:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Successfully created port: 079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Successfully updated port: 079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "refresh_cache-77c8cd9b-475e-4293-9050-c1b2cd8ed015" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquired lock "refresh_cache-77c8cd9b-475e-4293-9050-c1b2cd8ed015" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.compute.manager [req-367e4db5-dedc-4f56-904f-367d82646399 req-7b96811d-5216-4995-9ba0-a2128db80958 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-changed-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.compute.manager [req-367e4db5-dedc-4f56-904f-367d82646399 req-7b96811d-5216-4995-9ba0-a2128db80958 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Refreshing instance network info cache due to event network-changed-079356b3-bcfd-429d-a9bd-4f2c93cbf563. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-367e4db5-dedc-4f56-904f-367d82646399 req-7b96811d-5216-4995-9ba0-a2128db80958 service nova] Acquiring lock "refresh_cache-77c8cd9b-475e-4293-9050-c1b2cd8ed015" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:20 user sudo[84040]: pam_unix(sudo:session): session closed for user root
Aug 15 02:01:20 user nova-compute[73121]: INFO oslo.privsep.daemon [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Spawned new privsep daemon via rootwrap
Aug 15 02:01:20 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 02:01:20 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 02:01:20 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 15 02:01:20 user nova-compute[73121]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84043
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e8eac8-6ad4-4c3c-a9ad-39bbadb64bb3]: (2,) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c4bafa-3829-4a6f-8c00-1484badd064e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:20 user nova-compute[73121]: WARNING os_brick.initiator.connectors.nvmeof [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9359044-ea3f-4663-88ca-3912cc8ff6fd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b459a90e-1dc7-44ed-95e5-479dd06b33ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec01deb-f1af-4344-aa84-88b1849501f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Updating instance_info_cache with network_info: [{"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Releasing lock "refresh_cache-77c8cd9b-475e-4293-9050-c1b2cd8ed015" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance network_info: |[{"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:20 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[036c968f-99ca-461e-be71-3487bd934541]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-367e4db5-dedc-4f56-904f-367d82646399 req-7b96811d-5216-4995-9ba0-a2128db80958 service nova] Acquired lock "refresh_cache-77c8cd9b-475e-4293-9050-c1b2cd8ed015" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.network.neutron [req-367e4db5-dedc-4f56-904f-367d82646399 req-7b96811d-5216-4995-9ba0-a2128db80958 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Refreshing network info cache for port 079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG os_brick.utils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] <== get_connector_properties: return (2257ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Updating existing volume attachment record: e829acf6-3c42-489d-86c7-e6e10609382f {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.compute.manager [req-da81082c-8ca6-47de-ac00-80355ff5ab8e req-14952dcb-f029-4a63-a93a-f859999c189f service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received event network-vif-plugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-da81082c-8ca6-47de-ac00-80355ff5ab8e req-14952dcb-f029-4a63-a93a-f859999c189f service nova] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-da81082c-8ca6-47de-ac00-80355ff5ab8e req-14952dcb-f029-4a63-a93a-f859999c189f service nova] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-da81082c-8ca6-47de-ac00-80355ff5ab8e req-14952dcb-f029-4a63-a93a-f859999c189f service nova] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:20 user nova-compute[73121]: DEBUG nova.compute.manager [req-da81082c-8ca6-47de-ac00-80355ff5ab8e req-14952dcb-f029-4a63-a93a-f859999c189f service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] No waiting events found dispatching network-vif-plugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:20 user nova-compute[73121]: WARNING nova.compute.manager [req-da81082c-8ca6-47de-ac00-80355ff5ab8e req-14952dcb-f029-4a63-a93a-f859999c189f service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received unexpected event network-vif-plugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 for instance with vm_state active and task_state None.
Aug 15 02:01:21 user nova-compute[73121]: DEBUG nova.network.neutron [req-367e4db5-dedc-4f56-904f-367d82646399 req-7b96811d-5216-4995-9ba0-a2128db80958 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Updated VIF entry in instance network info cache for port 079356b3-bcfd-429d-a9bd-4f2c93cbf563. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:01:21 user nova-compute[73121]: DEBUG nova.network.neutron [req-367e4db5-dedc-4f56-904f-367d82646399 req-7b96811d-5216-4995-9ba0-a2128db80958 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Updating instance_info_cache with network_info: [{"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-367e4db5-dedc-4f56-904f-367d82646399 req-7b96811d-5216-4995-9ba0-a2128db80958 service nova] Releasing lock "refresh_cache-77c8cd9b-475e-4293-9050-c1b2cd8ed015" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received event network-vif-plugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] No waiting events found dispatching network-vif-plugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:22 user nova-compute[73121]: WARNING nova.compute.manager [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received unexpected event network-vif-plugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 for instance with vm_state active and task_state None.
Aug 15 02:01:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received event network-vif-plugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] No waiting events found dispatching network-vif-plugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:22 user nova-compute[73121]: WARNING nova.compute.manager [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received unexpected event network-vif-plugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 for instance with vm_state active and task_state None.
Aug 15 02:01:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received event network-vif-plugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] No waiting events found dispatching network-vif-plugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:22 user nova-compute[73121]: WARNING nova.compute.manager [req-a58aa786-de18-423c-aa6c-301c22df21bd req-c66969e5-c0f3-4594-a3a0-1db845fdaa3d service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received unexpected event network-vif-plugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 for instance with vm_state active and task_state None.
Aug 15 02:01:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-d2dc0191-0ca8-4fce-bfe4-89475dbaf103 req-da14cfef-0207-4a69-a202-a0da072cde7a service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received event network-vif-plugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d2dc0191-0ca8-4fce-bfe4-89475dbaf103 req-da14cfef-0207-4a69-a202-a0da072cde7a service nova] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d2dc0191-0ca8-4fce-bfe4-89475dbaf103 req-da14cfef-0207-4a69-a202-a0da072cde7a service nova] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d2dc0191-0ca8-4fce-bfe4-89475dbaf103 req-da14cfef-0207-4a69-a202-a0da072cde7a service nova] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-d2dc0191-0ca8-4fce-bfe4-89475dbaf103 req-da14cfef-0207-4a69-a202-a0da072cde7a service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] No waiting events found dispatching network-vif-plugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:23 user nova-compute[73121]: WARNING nova.compute.manager [req-d2dc0191-0ca8-4fce-bfe4-89475dbaf103 req-da14cfef-0207-4a69-a202-a0da072cde7a service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received unexpected event network-vif-plugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 for instance with vm_state active and task_state None.
Aug 15 02:01:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received event network-vif-plugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] No waiting events found dispatching network-vif-plugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:25 user nova-compute[73121]: WARNING nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received unexpected event network-vif-plugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 for instance with vm_state active and task_state None.
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-plugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] No waiting events found dispatching network-vif-plugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:25 user nova-compute[73121]: WARNING nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received unexpected event network-vif-plugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c for instance with vm_state active and task_state None.
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-plugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] No waiting events found dispatching network-vif-plugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:25 user nova-compute[73121]: WARNING nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received unexpected event network-vif-plugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c for instance with vm_state active and task_state None.
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received event network-vif-plugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] No waiting events found dispatching network-vif-plugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:25 user nova-compute[73121]: WARNING nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received unexpected event network-vif-plugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af for instance with vm_state active and task_state None.
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received event network-vif-plugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] No waiting events found dispatching network-vif-plugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:25 user nova-compute[73121]: WARNING nova.compute.manager [req-3d7fb061-4706-4f09-beaf-3c1b89053ae9 req-f4b18f69-dfcd-4401-a9ac-0991fa671de0 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received unexpected event network-vif-plugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af for instance with vm_state active and task_state None.
Aug 15 02:01:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:01:30 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Creating image(s)
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Ensure instance console log exists: /opt/stack/data/nova/instances/77c8cd9b-475e-4293-9050-c1b2cd8ed015/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Start _get_guest_xml network_info=[{"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'e829acf6-3c42-489d-86c7-e6e10609382f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqvKuwTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '77c8cd9b-475e-4293-9050-c1b2cd8ed015', 'attached_at': '', 'detached_at': '', 'volume_id': 'c84c4d82-7f25-4940-bf81-f97ec0247a32', 'serial': 'c84c4d82-7f25-4940-bf81-f97ec0247a32'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:01:30 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:01:30 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connector [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Factory for ISCSI on None {{(pid=73121) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqvKuwTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:01:30 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:01:30 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:01:30 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd34366-0bf1-4b39-87bc-a5b53dca7b52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:01:30 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd5c7f2-774c-4537-b767-6f6b40371953]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32] added
Aug 15 02:01:30 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dc9bd5-77f0-4bcb-9058-026f9092e9ef]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fb005a-d905-43c4-84af-c054a4161f0c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MqvKuwTm {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MqvKuwTm" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[325c7f77-0b2c-42c0-ad1a-d246b328e005]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MqvKuwTm'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d7bfbc-bb1c-4bd0-8550-880f4709bd25]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ac537-0cb1-49dc-8c69-6fe71b4f0a16]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:01:30 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:01:30 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:01:30 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:01:30 user nova-compute[73121]: 
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79e5e68-177f-4661-b464-f691b4c8110b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260]
Aug 15 02:01:30 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260] successful.
Aug 15 02:01:30 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64ffb3b-03c9-40bd-8fc7-f13f4d7bad0e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[62976293-ca3a-43bd-8632-b462b6a1e5f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:01:30 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:01:30 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[41037e19-5d2c-4871-95ee-068631f2ea7b]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:01:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqvKuwTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23266343765613039', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266343765613039', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1099324202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1099324202',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ8gEcMQAH0kKvlLTqDFoN126Q1iu/zZMIuFDLU7xxMwHV9ltLkgiaYzVdoyUTSZfNI34Auws52ZGHaGrri6N4rWPVwa87e5xkWI9k4aKald8BQ17zxIwAGqGM5Rgk/GA==',key_name='tempest-keypair-1468421416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a213fca0e8144873a2a412a9348d4d20',ramdisk_id='',reservation_id='r-qzagwdto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-776954851',owner_user_name='tempest-ServerActionsV293TestJSON-776954851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e0a6842bb14afda109782b1e26eaa9',uuid=77c8cd9b-475e-4293-9050-c1b2cd8ed015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converting VIF {"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lazy-loading 'pci_devices' on Instance uuid 77c8cd9b-475e-4293-9050-c1b2cd8ed015 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:01:31 user nova-compute[73121]:   <uuid>77c8cd9b-475e-4293-9050-c1b2cd8ed015</uuid>
Aug 15 02:01:31 user nova-compute[73121]:   <name>instance-0000000a</name>
Aug 15 02:01:31 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:01:31 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:01:31 user nova-compute[73121]:   <metadata>
Aug 15 02:01:31 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:01:31 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:01:31 user nova-compute[73121]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1099324202</nova:name>
Aug 15 02:01:31 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:01:30</nova:creationTime>
Aug 15 02:01:31 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:01:31 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:01:31 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:01:31 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:01:31 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:01:31 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:01:31 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:01:31 user nova-compute[73121]:       <nova:owner>
Aug 15 02:01:31 user nova-compute[73121]:         <nova:user uuid="c4e0a6842bb14afda109782b1e26eaa9">tempest-ServerActionsV293TestJSON-776954851-project-member</nova:user>
Aug 15 02:01:31 user nova-compute[73121]:         <nova:project uuid="a213fca0e8144873a2a412a9348d4d20">tempest-ServerActionsV293TestJSON-776954851</nova:project>
Aug 15 02:01:31 user nova-compute[73121]:       </nova:owner>
Aug 15 02:01:31 user nova-compute[73121]:       <nova:ports>
Aug 15 02:01:31 user nova-compute[73121]:         <nova:port uuid="079356b3-bcfd-429d-a9bd-4f2c93cbf563">
Aug 15 02:01:31 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 02:01:31 user nova-compute[73121]:         </nova:port>
Aug 15 02:01:31 user nova-compute[73121]:       </nova:ports>
Aug 15 02:01:31 user nova-compute[73121]:     </nova:instance>
Aug 15 02:01:31 user nova-compute[73121]:   </metadata>
Aug 15 02:01:31 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:01:31 user nova-compute[73121]:     <system>
Aug 15 02:01:31 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:01:31 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:01:31 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:01:31 user nova-compute[73121]:       <entry name="serial">77c8cd9b-475e-4293-9050-c1b2cd8ed015</entry>
Aug 15 02:01:31 user nova-compute[73121]:       <entry name="uuid">77c8cd9b-475e-4293-9050-c1b2cd8ed015</entry>
Aug 15 02:01:31 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:01:31 user nova-compute[73121]:     </system>
Aug 15 02:01:31 user nova-compute[73121]:   </sysinfo>
Aug 15 02:01:31 user nova-compute[73121]:   <os>
Aug 15 02:01:31 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:01:31 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:01:31 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:01:31 user nova-compute[73121]:   </os>
Aug 15 02:01:31 user nova-compute[73121]:   <features>
Aug 15 02:01:31 user nova-compute[73121]:     <acpi/>
Aug 15 02:01:31 user nova-compute[73121]:     <apic/>
Aug 15 02:01:31 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:01:31 user nova-compute[73121]:   </features>
Aug 15 02:01:31 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:01:31 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:01:31 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:01:31 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:01:31 user nova-compute[73121]:   </clock>
Aug 15 02:01:31 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:01:31 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:01:31 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:01:31 user nova-compute[73121]:   </cpu>
Aug 15 02:01:31 user nova-compute[73121]:   <devices>
Aug 15 02:01:31 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:01:31 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:01:31 user nova-compute[73121]:       <source dev="/dev/sdb"/>
Aug 15 02:01:31 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:01:31 user nova-compute[73121]:       <serial>c84c4d82-7f25-4940-bf81-f97ec0247a32</serial>
Aug 15 02:01:31 user nova-compute[73121]:     </disk>
Aug 15 02:01:31 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:01:31 user nova-compute[73121]:       <mac address="fa:16:3e:04:9d:5b"/>
Aug 15 02:01:31 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:01:31 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:01:31 user nova-compute[73121]:       <target dev="tap079356b3-bc"/>
Aug 15 02:01:31 user nova-compute[73121]:     </interface>
Aug 15 02:01:31 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:01:31 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/77c8cd9b-475e-4293-9050-c1b2cd8ed015/console.log" append="off"/>
Aug 15 02:01:31 user nova-compute[73121]:     </serial>
Aug 15 02:01:31 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:01:31 user nova-compute[73121]:     <video>
Aug 15 02:01:31 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:01:31 user nova-compute[73121]:     </video>
Aug 15 02:01:31 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:01:31 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:01:31 user nova-compute[73121]:     </rng>
Aug 15 02:01:31 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:01:31 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:01:31 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:01:31 user nova-compute[73121]:     </memballoon>
Aug 15 02:01:31 user nova-compute[73121]:   </devices>
Aug 15 02:01:31 user nova-compute[73121]: </domain>
Aug 15 02:01:31 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1099324202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1099324202',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ8gEcMQAH0kKvlLTqDFoN126Q1iu/zZMIuFDLU7xxMwHV9ltLkgiaYzVdoyUTSZfNI34Auws52ZGHaGrri6N4rWPVwa87e5xkWI9k4aKald8BQ17zxIwAGqGM5Rgk/GA==',key_name='tempest-keypair-1468421416',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a213fca0e8144873a2a412a9348d4d20',ramdisk_id='',reservation_id='r-qzagwdto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-776954851',owner_user_name='tempest-ServerActionsV293TestJSON-776954851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e0a6842bb14afda109782b1e26eaa9',uuid=77c8cd9b-475e-4293-9050-c1b2cd8ed015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converting VIF {"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG os_vif [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap079356b3-bc, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap079356b3-bc, col_values=(('external_ids', {'iface-id': '079356b3-bcfd-429d-a9bd-4f2c93cbf563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:9d:5b', 'vm-uuid': '77c8cd9b-475e-4293-9050-c1b2cd8ed015'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:01:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:31 user nova-compute[73121]: INFO os_vif [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc')
Aug 15 02:01:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:01:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] No VIF found with MAC fa:16:3e:04:9d:5b, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-1765cb82-012c-402d-953a-ee01e5a2d77d req-0c5ba163-60ee-4405-9dde-4f0416223911 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1765cb82-012c-402d-953a-ee01e5a2d77d req-0c5ba163-60ee-4405-9dde-4f0416223911 service nova] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1765cb82-012c-402d-953a-ee01e5a2d77d req-0c5ba163-60ee-4405-9dde-4f0416223911 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1765cb82-012c-402d-953a-ee01e5a2d77d req-0c5ba163-60ee-4405-9dde-4f0416223911 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-1765cb82-012c-402d-953a-ee01e5a2d77d req-0c5ba163-60ee-4405-9dde-4f0416223911 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] No waiting events found dispatching network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:33 user nova-compute[73121]: WARNING nova.compute.manager [req-1765cb82-012c-402d-953a-ee01e5a2d77d req-0c5ba163-60ee-4405-9dde-4f0416223911 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received unexpected event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 for instance with vm_state building and task_state spawning.
Aug 15 02:01:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064895.465754, 77c8cd9b-475e-4293-9050-c1b2cd8ed015 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:35 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] VM Resumed (Lifecycle Event)
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:01:35 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance spawned successfully.
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:01:35 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064895.4675663, 77c8cd9b-475e-4293-9050-c1b2cd8ed015 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:01:35 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] VM Started (Lifecycle Event)
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:01:35 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:01:35 user nova-compute[73121]: INFO nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b014e7a-a42d-4486-a28e-42e0a47ce53d req-0ed4185d-f841-4eae-8189-7c514a51a2c9 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b014e7a-a42d-4486-a28e-42e0a47ce53d req-0ed4185d-f841-4eae-8189-7c514a51a2c9 service nova] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b014e7a-a42d-4486-a28e-42e0a47ce53d req-0ed4185d-f841-4eae-8189-7c514a51a2c9 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b014e7a-a42d-4486-a28e-42e0a47ce53d req-0ed4185d-f841-4eae-8189-7c514a51a2c9 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:35 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b014e7a-a42d-4486-a28e-42e0a47ce53d req-0ed4185d-f841-4eae-8189-7c514a51a2c9 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] No waiting events found dispatching network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:01:35 user nova-compute[73121]: WARNING nova.compute.manager [req-0b014e7a-a42d-4486-a28e-42e0a47ce53d req-0ed4185d-f841-4eae-8189-7c514a51a2c9 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received unexpected event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 for instance with vm_state building and task_state spawning.
Aug 15 02:01:35 user nova-compute[73121]: INFO nova.compute.manager [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Took 18.17 seconds to build instance.
Aug 15 02:01:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f23a4289-5bab-4b17-a6f3-38c72cf2b638 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.288s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "3626675d-6ed7-400c-998f-67501a107da3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:01:43 user nova-compute[73121]: INFO nova.compute.claims [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Claim successful on node user
Aug 15 02:01:43 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:01:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:01:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:01:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:01:43 user nova-compute[73121]: INFO nova.virt.block_device [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Booting with volume ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf at /dev/vda
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.policy [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d2668ffb2e04520b8a4e582afa747a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14b2d4d29f2e48258adf11773b32df1e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG os_brick.utils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[062afe66-2c2d-4071-886a-5f49b75589f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "b14c5889-916d-43cf-8faa-4373a5703c84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[00511a28-8432-4e61-8b37-716569c48b83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b650934-8157-4c97-8842-c20f473e6ef2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[658ee952-0d1b-4a45-a1bf-a8f30811e9a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:44 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dc3bf2-9967-45da-9cbb-8ace7b714a98]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG os_brick.utils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating existing volume attachment record: 9eaca562-3e46-429c-a869-0c6832dc1dbb {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:01:44 user nova-compute[73121]: INFO nova.compute.claims [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Claim successful on node user
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully created port: 63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:01:44 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:01:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:01:45 user nova-compute[73121]: INFO nova.virt.block_device [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Booting with volume 60eafcfc-720b-4f84-820b-9f2d15c593be at /dev/vda
Aug 15 02:01:45 user nova-compute[73121]: DEBUG nova.policy [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efee72a4c2b24e7fb19b58f6a26e173c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf24913e47a44edfa2f7105cda66cefa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG os_brick.utils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1da37e4-37ee-4f39-ae9a-9b19ce484d3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a744733-e4af-4e54-a876-380848f0ff3a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[49108232-f97d-4ac0-af1f-e51c3ccfe643]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7286b54a-7463-4be3-9549-3f2b483fe7f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully created port: 5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:45 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:01:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e38b715-0469-4541-83d5-109c36e3db08]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG os_brick.utils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating existing volume attachment record: 41bff9ff-c3b5-4dcd-9575-fe33dae96bda {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully created port: 204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:45 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully created port: 6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:46 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully created port: e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:46 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully created port: bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:46 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully created port: 1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:47 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully created port: 5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:47 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully created port: 8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully updated port: 63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-127d8dd2-919b-4d78-afae-86fcf80acfbd req-61bf358d-d639-41e2-8bc1-af36d9e70ba9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-changed-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-127d8dd2-919b-4d78-afae-86fcf80acfbd req-61bf358d-d639-41e2-8bc1-af36d9e70ba9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing instance network info cache due to event network-changed-63b8a051-1128-4b55-bc00-de6e0375820f. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-127d8dd2-919b-4d78-afae-86fcf80acfbd req-61bf358d-d639-41e2-8bc1-af36d9e70ba9 service nova] Acquiring lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-127d8dd2-919b-4d78-afae-86fcf80acfbd req-61bf358d-d639-41e2-8bc1-af36d9e70ba9 service nova] Acquired lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-127d8dd2-919b-4d78-afae-86fcf80acfbd req-61bf358d-d639-41e2-8bc1-af36d9e70ba9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing network info cache for port 63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-127d8dd2-919b-4d78-afae-86fcf80acfbd req-61bf358d-d639-41e2-8bc1-af36d9e70ba9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully created port: 39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-127d8dd2-919b-4d78-afae-86fcf80acfbd req-61bf358d-d639-41e2-8bc1-af36d9e70ba9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-127d8dd2-919b-4d78-afae-86fcf80acfbd req-61bf358d-d639-41e2-8bc1-af36d9e70ba9 service nova] Releasing lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully updated port: f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully updated port: 204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-0952541e-614f-488c-81ce-a0708712f0b2 req-9d536df1-7778-48a8-92b3-a116d19dabfd service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-changed-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-0952541e-614f-488c-81ce-a0708712f0b2 req-9d536df1-7778-48a8-92b3-a116d19dabfd service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing instance network info cache due to event network-changed-204821bd-61e9-471a-b225-84018c93b370. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0952541e-614f-488c-81ce-a0708712f0b2 req-9d536df1-7778-48a8-92b3-a116d19dabfd service nova] Acquiring lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0952541e-614f-488c-81ce-a0708712f0b2 req-9d536df1-7778-48a8-92b3-a116d19dabfd service nova] Acquired lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-0952541e-614f-488c-81ce-a0708712f0b2 req-9d536df1-7778-48a8-92b3-a116d19dabfd service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing network info cache for port 204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-0952541e-614f-488c-81ce-a0708712f0b2 req-9d536df1-7778-48a8-92b3-a116d19dabfd service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-0952541e-614f-488c-81ce-a0708712f0b2 req-9d536df1-7778-48a8-92b3-a116d19dabfd service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0952541e-614f-488c-81ce-a0708712f0b2 req-9d536df1-7778-48a8-92b3-a116d19dabfd service nova] Releasing lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully updated port: f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully updated port: c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-changed-f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing instance network info cache due to event network-changed-f0f11527-ae15-42d4-98d6-74c2d031efe1. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] Acquiring lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] Acquired lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing network info cache for port f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] Releasing lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-changed-f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing instance network info cache due to event network-changed-f2f84e08-dc37-4478-916a-8d3a90d8b298. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] Acquiring lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] Acquired lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing network info cache for port f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully updated port: 5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7872a2ea-2f03-48c9-9616-e1c3ad77cba4 req-1d4e5773-df2d-4744-9d55-3741dc79bd5b service nova] Releasing lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully updated port: 6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully updated port: 6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-changed-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing instance network info cache due to event network-changed-c1a3db14-7ef4-4d41-8476-38b88f4e62c9. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] Acquiring lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] Acquired lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing network info cache for port c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully updated port: e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-changed-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing instance network info cache due to event network-changed-5e6c3c5c-51d2-4e94-9588-10dcd56ff249. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] Acquiring lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] Acquired lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing network info cache for port 5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] Releasing lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-changed-6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing instance network info cache due to event network-changed-6f68bad0-3cde-4382-b499-61d134c3fbce. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] Acquiring lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] Acquired lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing network info cache for port 6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully updated port: bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63578e23-875f-4537-a349-6fce22e0aef7 req-28585f3c-8609-478e-a90f-fc496a29c644 service nova] Releasing lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:52 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully updated port: 1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.network.neutron [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] Releasing lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-changed-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing instance network info cache due to event network-changed-6de97b6c-9106-49f3-b959-ef35cb48c6a1. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] Acquiring lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] Acquired lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.network.neutron [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing network info cache for port 6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.network.neutron [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully updated port: 8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.network.neutron [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a010189a-9a0a-434b-8d3b-3be2c668add0 req-db9c49e5-1f70-4c3f-aa88-4c124d35137e service nova] Releasing lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-changed-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing instance network info cache due to event network-changed-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] Acquiring lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] Acquired lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing network info cache for port e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Successfully updated port: 5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquired lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] Releasing lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-changed-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing instance network info cache due to event network-changed-1785fd4a-8241-4c47-9f08-925c7fc16480. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] Acquiring lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] Acquired lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing network info cache for port 1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-changed-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing instance network info cache due to event network-changed-bddc610c-078b-4886-b60d-df61562e4852. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] Acquiring lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:54 user nova-compute[73121]: INFO nova.virt.block_device [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Booting with volume 2abc33a6-5dc9-45f9-937b-6022743a7ba2 at /dev/vdb
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Successfully updated port: 39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG os_brick.utils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ffb069-2f4f-4ec2-86a6-eb30e31f0e87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5d7fb7-3067-4c47-915c-69cf8cbd7b2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[955997ff-cfb9-4ad9-967e-d0fba1d88ecb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daca950-5ba3-4884-8a33-8df50018e2f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:54 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd20fab5-1b27-48aa-b915-aa6f248f76eb]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG os_brick.utils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating existing volume attachment record: 6e9f603c-c76f-4b47-b830-21ea8fb6e407 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] Releasing lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-changed-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing instance network info cache due to event network-changed-8d9efae5-16d3-48bb-b65b-fd44b2cebc26. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] Acquiring lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] Acquired lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing network info cache for port 8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:54 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6884d7d-577d-4646-8daa-de80a74743b1 req-87465fac-dcd0-43ab-bd7b-102eeb9e9a9a service nova] Releasing lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquired lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:01:55 user nova-compute[73121]: INFO nova.virt.block_device [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Booting with volume 56e32cd2-362c-4d9e-b710-91db0185f1c2 at /dev/vdb
Aug 15 02:01:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG os_brick.utils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[88896b1f-6a5e-45bb-9812-0790faed2cb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8d870d-4b88-4151-b85c-cee905f342e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d3c08-29c5-4cc9-98e9-577767de4e58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c40fdc-71dc-4baf-9915-be76e054f583]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:01:55 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e26665f-29ad-42ce-937c-8590baa9ddb5]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG os_brick.utils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating existing volume attachment record: e9e69a13-6e6c-4d12-8b4b-ea5822aba814 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-29aecbf8-4aa7-41f6-9080-7f06e340bd03 req-e072c0c5-da06-4b37-a363-95938a4f1ca6 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-changed-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-29aecbf8-4aa7-41f6-9080-7f06e340bd03 req-e072c0c5-da06-4b37-a363-95938a4f1ca6 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing instance network info cache due to event network-changed-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-29aecbf8-4aa7-41f6-9080-7f06e340bd03 req-e072c0c5-da06-4b37-a363-95938a4f1ca6 service nova] Acquiring lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:01:57 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [{"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Releasing lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance network_info: |[{"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:01:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] Acquired lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:57 user nova-compute[73121]: DEBUG nova.network.neutron [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing network info cache for port bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG nova.network.neutron [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updated VIF entry in instance network info cache for port bddc610c-078b-4886-b60d-df61562e4852. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG nova.network.neutron [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [{"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] Releasing lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-changed-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing instance network info cache due to event network-changed-5e3b9c4d-df3e-4d98-840d-9cc5d4124126. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] Acquiring lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] Acquired lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG nova.network.neutron [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing network info cache for port 5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG nova.network.neutron [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [{"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Releasing lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance network_info: |[{"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-29aecbf8-4aa7-41f6-9080-7f06e340bd03 req-e072c0c5-da06-4b37-a363-95938a4f1ca6 service nova] Acquired lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:01:58 user nova-compute[73121]: DEBUG nova.network.neutron [req-29aecbf8-4aa7-41f6-9080-7f06e340bd03 req-e072c0c5-da06-4b37-a363-95938a4f1ca6 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing network info cache for port 39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:01:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updated VIF entry in instance network info cache for port 5e3b9c4d-df3e-4d98-840d-9cc5d4124126. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:01:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [{"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-15755f71-7790-407b-b5ad-bc053a253372 req-a8a228b0-05cc-458c-9dce-fb1d98579bdd service nova] Releasing lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:01:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-29aecbf8-4aa7-41f6-9080-7f06e340bd03 req-e072c0c5-da06-4b37-a363-95938a4f1ca6 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updated VIF entry in instance network info cache for port 39cfe07e-3541-48b9-8b3e-4cbe3817bdc7. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:01:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-29aecbf8-4aa7-41f6-9080-7f06e340bd03 req-e072c0c5-da06-4b37-a363-95938a4f1ca6 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [{"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:01:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-29aecbf8-4aa7-41f6-9080-7f06e340bd03 req-e072c0c5-da06-4b37-a363-95938a4f1ca6 service nova] Releasing lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:03 user nova-compute[73121]: INFO nova.virt.block_device [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Booting with volume 5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 at /dev/vdc
Aug 15 02:02:03 user nova-compute[73121]: DEBUG os_brick.utils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dbffef-fad6-445a-a883-af1939d4ea0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1e048f-8095-4eb1-8872-45b9a8d4596a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe2bad9-f49e-457b-8cd0-0f5fa18180f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94311d3-716e-4b51-a9d3-a92bb458fd8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:04 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2074727f-6e81-4dfd-84c2-6a029a308510]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.utils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating existing volume attachment record: 526d897d-d802-4b20-a886-addc1e6ca191 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:02:04 user nova-compute[73121]: INFO nova.virt.block_device [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Booting with volume 06278906-6755-4ee9-bb24-233af1e6e8b1 at /dev/vdc
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.utils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6a2926-d963-4132-9938-8660a3c35fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7557300-7c07-4c9f-9c0e-e3cd7664a866]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73cac45-c463-4afd-a50f-92156d8dd1cd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b8a4a9-1dd9-4d9d-8962-12fd34ae97be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:04 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:02:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa4c758-fd05-4e7a-abc4-0bad20fabbcd]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG os_brick.utils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:04 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating existing volume attachment record: 8235423f-d96c-499e-8d08-4cd793d5fc6e {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:02:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:10 user nova-compute[73121]: INFO nova.compute.manager [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] instance snapshotting
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:02:10 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Beginning live snapshot process
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json -f qcow2 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json -f qcow2 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating instance_info_cache with network_info: [{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx5y_4c83/c803e8bf5da840a9a9f8c8817e21fd1a.delta 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpx5y_4c83/c803e8bf5da840a9a9f8c8817e21fd1a.delta 1073741824" returned: 0 in 0.046s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:10 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 02:02:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73121) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 15 02:02:10 user nova-compute[73121]: INFO nova.virt.libvirt.host [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] UEFI support detected
Aug 15 02:02:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:02:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-f6fd81a9-43a0-41b7-ab68-d4d561165542 req-c4eb0bfd-b1e4-42a5-aece-ca41203957ba service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-changed-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-f6fd81a9-43a0-41b7-ab68-d4d561165542 req-c4eb0bfd-b1e4-42a5-aece-ca41203957ba service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Refreshing instance network info cache due to event network-changed-896acc02-dd7e-4464-be83-5a9774c03d22. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:02:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6fd81a9-43a0-41b7-ab68-d4d561165542 req-c4eb0bfd-b1e4-42a5-aece-ca41203957ba service nova] Acquiring lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6fd81a9-43a0-41b7-ab68-d4d561165542 req-c4eb0bfd-b1e4-42a5-aece-ca41203957ba service nova] Acquired lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:11 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6fd81a9-43a0-41b7-ab68-d4d561165542 req-c4eb0bfd-b1e4-42a5-aece-ca41203957ba service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Refreshing network info cache for port 896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:02:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:02:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6fd81a9-43a0-41b7-ab68-d4d561165542 req-c4eb0bfd-b1e4-42a5-aece-ca41203957ba service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updated VIF entry in instance network info cache for port 896acc02-dd7e-4464-be83-5a9774c03d22. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG nova.network.neutron [req-f6fd81a9-43a0-41b7-ab68-d4d561165542 req-c4eb0bfd-b1e4-42a5-aece-ca41203957ba service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating instance_info_cache with network_info: [{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f6fd81a9-43a0-41b7-ab68-d4d561165542 req-c4eb0bfd-b1e4-42a5-aece-ca41203957ba service nova] Releasing lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:02:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 02:02:12 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx5y_4c83/c803e8bf5da840a9a9f8c8817e21fd1a.delta /opt/stack/data/nova/instances/snapshots/tmpx5y_4c83/c803e8bf5da840a9a9f8c8817e21fd1a {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpx5y_4c83/c803e8bf5da840a9a9f8c8817e21fd1a.delta /opt/stack/data/nova/instances/snapshots/tmpx5y_4c83/c803e8bf5da840a9a9f8c8817e21fd1a" returned: 0 in 0.652s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Snapshot extracted, beginning image upload
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:02:14 user nova-compute[73121]: INFO nova.compute.claims [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Claim successful on node user
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:02:14 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Creating image(s)
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Ensure instance console log exists: /opt/stack/data/nova/instances/3626675d-6ed7-400c-998f-67501a107da3/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Start _get_guest_xml network_info=[{"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '9eaca562-3e46-429c-a869-0c6832dc1dbb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlEOcVuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3626675d-6ed7-400c-998f-67501a107da3', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf', 'serial': 'ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '6e9f603c-c76f-4b47-b830-21ea8fb6e407', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqCStXxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3626675d-6ed7-400c-998f-67501a107da3', 'attached_at': '', 'detached_at': '', 'volume_id': '2abc33a6-5dc9-45f9-937b-6022743a7ba2', 'serial': '2abc33a6-5dc9-45f9-937b-6022743a7ba2'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '526d897d-d802-4b20-a886-addc1e6ca191', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTldYufj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3626675d-6ed7-400c-998f-67501a107da3', 'attached_at': '', 'detached_at': '', 'volume_id': '5a0dad82-dc1b-48aa-86d3-f3d48c2c5054', 'serial': '5a0dad82-dc1b-48aa-86d3-f3d48c2c5054'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:02:14 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:02:14 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlEOcVuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:14 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:14 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:14 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b039f3-361e-4a1f-bfe1-ded14d65c8fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:14 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efc3cb7-eba4-4a3a-8542-c2d07dcc6ca2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf] added
Aug 15 02:02:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdcbfa4-7f22-4f3c-a0fe-6d9635f70b50]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f07785-2d80-4568-9f8f-e3e35aa0bc32]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlEOcVuY {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IlEOcVuY" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bf1a41-356b-4c2a-a27d-cf67205d5265]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IlEOcVuY'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3cf662-bf4d-41d5-b8bf-14b3f4a2c78a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e58121-776e-4f48-98fd-ddecca9391b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[063cc7d9-ca20-403f-9568-dad09a0dc63c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf, portal: 172.16.0.220,3260]
Aug 15 02:02:14 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c554d-c2fd-4d48-9908-5187b7e2b3b0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb31a7-ee60-4e87-b66f-d6cdcde86123]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:14 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:14 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.739s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[de36bbf4-9c0e-4c20-8bc2-e51c59aff828]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlEOcVuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:02:15 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.policy [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e4105e54b7264bb3aa05ceeccbf32277', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104f505852da4e74b4afddadf5b4a9a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:02:15 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Creating image(s)
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Ensure instance console log exists: /opt/stack/data/nova/instances/b14c5889-916d-43cf-8faa-4373a5703c84/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Start _get_guest_xml network_info=[{"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '41bff9ff-c3b5-4dcd-9575-fe33dae96bda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwugfiYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b14c5889-916d-43cf-8faa-4373a5703c84', 'attached_at': '', 'detached_at': '', 'volume_id': '60eafcfc-720b-4f84-820b-9f2d15c593be', 'serial': '60eafcfc-720b-4f84-820b-9f2d15c593be'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdb', 'boot_index': 1, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'e9e69a13-6e6c-4d12-8b4b-ea5822aba814', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLlzyWfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b14c5889-916d-43cf-8faa-4373a5703c84', 'attached_at': '', 'detached_at': '', 'volume_id': '56e32cd2-362c-4d9e-b710-91db0185f1c2', 'serial': '56e32cd2-362c-4d9e-b710-91db0185f1c2'}, 'guest_format': None, 'volume_type': None}, {'mount_device': '/dev/vdc', 'boot_index': 2, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '8235423f-d96c-499e-8d08-4cd793d5fc6e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xfRrkYGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b14c5889-916d-43cf-8faa-4373a5703c84', 'attached_at': '', 'detached_at': '', 'volume_id': '06278906-6755-4ee9-bb24-233af1e6e8b1', 'serial': '06278906-6755-4ee9-bb24-233af1e6e8b1'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:02:15 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Creating image(s)
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "/opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "/opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "/opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:15 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:02:15 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwugfiYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:15 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:15 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.227s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk 1073741824" returned: 0 in 0.075s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:15 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Snapshot image upload complete
Aug 15 02:02:15 user nova-compute[73121]: INFO nova.compute.manager [None req-a67cfa6a-137b-42c8-9df4-4c6b1496e9e2 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Took 5.81 seconds to snapshot the instance on the hypervisor.
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:02:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.540s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] <== connect_volume: return (1544ms) {'type': 'block', 'scsi_wwn': '23866346137343162', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866346137343162', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Successfully created port: 9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.598s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:16 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:16 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[83da15fe-ff47-4c92-9531-2cfbda3e9a15]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:16 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqCStXxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:16 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46676e9-839e-4828-84ae-8b585b5c6fcd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be] added
Aug 15 02:02:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9507f4-d9fe-444f-95de-5ce2e8895503]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4758141-e19f-42e5-8e28-3dca092c08f3]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwugfiYc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GwugfiYc" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c88794a-0091-431c-8066-f8a603552b23]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GwugfiYc'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk --force-share --output=json" returned: 0 in 0.613s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Cannot resize image /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lazy-loading 'migration_context' on Instance uuid 8404c6b1-afcf-4362-a767-f3c18d50ebf0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:02:16 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=6823MB free_disk=25.66387176513672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Ensure instance console log exists: /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[55696f5c-7e86-445a-ac6e-c1fd31807d8d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ded209-a3ee-4ee3-9883-da60dac39b20]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:16 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:16 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0a9433-ec5a-4882-9e5e-e058340520dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be, portal: 172.16.0.220,3260]
Aug 15 02:02:16 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[929392e3-9337-4f81-ab7d-b8fb727a9d1b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 4e04a498-4518-46c9-bc49-4d0d5d6aa054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 78cda252-7cca-412c-ac97-24fc375d32de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7d7ea92-e89a-43cb-8e41-b983fa788244 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 793cddda-b586-4601-9f22-47938c9ccfb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 66e5ded4-d25e-443f-b000-df3b693555dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 03db2b8d-c678-4763-a87c-93e001ed9605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 77c8cd9b-475e-4293-9050-c1b2cd8ed015 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 3626675d-6ed7-400c-998f-67501a107da3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance b14c5889-916d-43cf-8faa-4373a5703c84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 8404c6b1-afcf-4362-a767-f3c18d50ebf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdbe614-152a-4349-a96a-82b6b7061128]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:16 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:16 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:16 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:16 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.732s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Successfully updated port: 9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea8eae-eaad-4ca0-a27d-b4a7d94e2443]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwugfiYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "refresh_cache-8404c6b1-afcf-4362-a767-f3c18d50ebf0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquired lock "refresh_cache-8404c6b1-afcf-4362-a767-f3c18d50ebf0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b194a10-ec47-4197-bcb2-017b16fbd01f req-3cc7c98e-7b09-4f59-b713-24e56cf87804 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received event network-changed-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b194a10-ec47-4197-bcb2-017b16fbd01f req-3cc7c98e-7b09-4f59-b713-24e56cf87804 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Refreshing instance network info cache due to event network-changed-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b194a10-ec47-4197-bcb2-017b16fbd01f req-3cc7c98e-7b09-4f59-b713-24e56cf87804 service nova] Acquiring lock "refresh_cache-8404c6b1-afcf-4362-a767-f3c18d50ebf0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:02:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:17 user nova-compute[73121]: INFO nova.compute.manager [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Attaching volume 77a6f9a6-c8fa-429d-9c83-c270ccb11f5a to /dev/vdb
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.utils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[264a6fa7-a1b8-4936-bf38-f58add271ded]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f913cd3-9f35-4898-9dec-e545fce4f961]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db11d5e-5732-42a1-ab4c-865faf4fe7b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0c68ae-435f-4cc2-a00c-a088fadc1fe8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:17 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[868eb6ed-3e19-4eb9-a9a1-c23c69b61815]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.utils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating existing volume attachment record: 80acfc14-e08f-4cba-80b3-cecac7224b94 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Updating instance_info_cache with network_info: [{"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.707s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Releasing lock "refresh_cache-8404c6b1-afcf-4362-a767-f3c18d50ebf0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Instance network_info: |[{"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b194a10-ec47-4197-bcb2-017b16fbd01f req-3cc7c98e-7b09-4f59-b713-24e56cf87804 service nova] Acquired lock "refresh_cache-8404c6b1-afcf-4362-a767-f3c18d50ebf0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.network.neutron [req-0b194a10-ec47-4197-bcb2-017b16fbd01f req-3cc7c98e-7b09-4f59-b713-24e56cf87804 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Refreshing network info cache for port 9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Start _get_guest_xml network_info=[{"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:02:17 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:02:17 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1566789889',display_name='tempest-ServersNegativeTestJSON-server-1566789889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1566789889',id=13,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='104f505852da4e74b4afddadf5b4a9a5',ramdisk_id='',reservation_id='r-69hblso5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-68547960',owner_user_name='tempest-ServersNegativeTestJSON-68547960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:02:15Z,user_data=None,user_id='e4105e54b7264bb3aa05ceeccbf32277',uuid=8404c6b1-afcf-4362-a767-f3c18d50ebf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converting VIF {"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=9f73b74c-f5fe-4bff-b97f-92219cd1e3a9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f73b74c-f5') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lazy-loading 'pci_devices' on Instance uuid 8404c6b1-afcf-4362-a767-f3c18d50ebf0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:02:17 user nova-compute[73121]:   <uuid>8404c6b1-afcf-4362-a767-f3c18d50ebf0</uuid>
Aug 15 02:02:17 user nova-compute[73121]:   <name>instance-0000000d</name>
Aug 15 02:02:17 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:02:17 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:02:17 user nova-compute[73121]:   <metadata>
Aug 15 02:02:17 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:02:17 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:02:17 user nova-compute[73121]:       <nova:name>tempest-ServersNegativeTestJSON-server-1566789889</nova:name>
Aug 15 02:02:17 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:02:17</nova:creationTime>
Aug 15 02:02:17 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:02:17 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:02:17 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:02:17 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:02:17 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:02:17 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:02:17 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:02:17 user nova-compute[73121]:       <nova:owner>
Aug 15 02:02:17 user nova-compute[73121]:         <nova:user uuid="e4105e54b7264bb3aa05ceeccbf32277">tempest-ServersNegativeTestJSON-68547960-project-member</nova:user>
Aug 15 02:02:17 user nova-compute[73121]:         <nova:project uuid="104f505852da4e74b4afddadf5b4a9a5">tempest-ServersNegativeTestJSON-68547960</nova:project>
Aug 15 02:02:17 user nova-compute[73121]:       </nova:owner>
Aug 15 02:02:17 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:02:17 user nova-compute[73121]:       <nova:ports>
Aug 15 02:02:17 user nova-compute[73121]:         <nova:port uuid="9f73b74c-f5fe-4bff-b97f-92219cd1e3a9">
Aug 15 02:02:17 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 02:02:17 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:17 user nova-compute[73121]:       </nova:ports>
Aug 15 02:02:17 user nova-compute[73121]:     </nova:instance>
Aug 15 02:02:17 user nova-compute[73121]:   </metadata>
Aug 15 02:02:17 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:02:17 user nova-compute[73121]:     <system>
Aug 15 02:02:17 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:02:17 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:02:17 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:02:17 user nova-compute[73121]:       <entry name="serial">8404c6b1-afcf-4362-a767-f3c18d50ebf0</entry>
Aug 15 02:02:17 user nova-compute[73121]:       <entry name="uuid">8404c6b1-afcf-4362-a767-f3c18d50ebf0</entry>
Aug 15 02:02:17 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:02:17 user nova-compute[73121]:     </system>
Aug 15 02:02:17 user nova-compute[73121]:   </sysinfo>
Aug 15 02:02:17 user nova-compute[73121]:   <os>
Aug 15 02:02:17 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:02:17 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:02:17 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:02:17 user nova-compute[73121]:   </os>
Aug 15 02:02:17 user nova-compute[73121]:   <features>
Aug 15 02:02:17 user nova-compute[73121]:     <acpi/>
Aug 15 02:02:17 user nova-compute[73121]:     <apic/>
Aug 15 02:02:17 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:02:17 user nova-compute[73121]:   </features>
Aug 15 02:02:17 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:02:17 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:02:17 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:02:17 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:02:17 user nova-compute[73121]:   </clock>
Aug 15 02:02:17 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:02:17 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:02:17 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:02:17 user nova-compute[73121]:   </cpu>
Aug 15 02:02:17 user nova-compute[73121]:   <devices>
Aug 15 02:02:17 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:02:17 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:02:17 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk"/>
Aug 15 02:02:17 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:02:17 user nova-compute[73121]:     </disk>
Aug 15 02:02:17 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:17 user nova-compute[73121]:       <mac address="fa:16:3e:92:ea:aa"/>
Aug 15 02:02:17 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:17 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:17 user nova-compute[73121]:       <target dev="tap9f73b74c-f5"/>
Aug 15 02:02:17 user nova-compute[73121]:     </interface>
Aug 15 02:02:17 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:02:17 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/console.log" append="off"/>
Aug 15 02:02:17 user nova-compute[73121]:     </serial>
Aug 15 02:02:17 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:02:17 user nova-compute[73121]:     <video>
Aug 15 02:02:17 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:17 user nova-compute[73121]:     </video>
Aug 15 02:02:17 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:02:17 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:02:17 user nova-compute[73121]:     </rng>
Aug 15 02:02:17 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:02:17 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:02:17 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:02:17 user nova-compute[73121]:     </memballoon>
Aug 15 02:02:17 user nova-compute[73121]:   </devices>
Aug 15 02:02:17 user nova-compute[73121]: </domain>
Aug 15 02:02:17 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1566789889',display_name='tempest-ServersNegativeTestJSON-server-1566789889',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1566789889',id=13,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='104f505852da4e74b4afddadf5b4a9a5',ramdisk_id='',reservation_id='r-69hblso5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-68547960',owner_user_name='tempest-ServersNegativeTestJSON-68547960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:02:15Z,user_data=None,user_id='e4105e54b7264bb3aa05ceeccbf32277',uuid=8404c6b1-afcf-4362-a767-f3c18d50ebf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converting VIF {"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=9f73b74c-f5fe-4bff-b97f-92219cd1e3a9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f73b74c-f5') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_vif [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=9f73b74c-f5fe-4bff-b97f-92219cd1e3a9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f73b74c-f5') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f73b74c-f5, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9f73b74c-f5, col_values=(('external_ids', {'iface-id': '9f73b74c-f5fe-4bff-b97f-92219cd1e3a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:ea:aa', 'vm-uuid': '8404c6b1-afcf-4362-a767-f3c18d50ebf0'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:17 user nova-compute[73121]: INFO os_vif [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=9f73b74c-f5fe-4bff-b97f-92219cd1e3a9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f73b74c-f5')
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] No VIF found with MAC fa:16:3e:92:ea:aa, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.network.neutron [req-0b194a10-ec47-4197-bcb2-017b16fbd01f req-3cc7c98e-7b09-4f59-b713-24e56cf87804 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Updated VIF entry in instance network info cache for port 9f73b74c-f5fe-4bff-b97f-92219cd1e3a9. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.network.neutron [req-0b194a10-ec47-4197-bcb2-017b16fbd01f req-3cc7c98e-7b09-4f59-b713-24e56cf87804 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Updating instance_info_cache with network_info: [{"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b194a10-ec47-4197-bcb2-017b16fbd01f req-3cc7c98e-7b09-4f59-b713-24e56cf87804 service nova] Releasing lock "refresh_cache-8404c6b1-afcf-4362-a767-f3c18d50ebf0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.769s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] <== connect_volume: return (2367ms) {'type': 'block', 'scsi_wwn': '23662656432333431', 'path': '/dev/sdd'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662656432333431', 'path': '/dev/sdd'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.738s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:17 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:17 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d41e595-4e78-4613-82a7-d3106f1ff064]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:17 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLlzyWfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:17 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be00298-c550-4b59-9be7-0811bfcc2483]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2] added
Aug 15 02:02:17 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[50852991-5fa5-403b-9e9b-c0bb511237f2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b55b11-6c5f-4b0a-aeff-67aa025b553c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqCStXxZ {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vqCStXxZ" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c2ee72-2fd1-4e40-a4f2-102d2f9199a3]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vqCStXxZ'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6535cfd-3b0a-41f6-8381-af86acd6cb54]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af5934f-a83a-4306-ac33-a16c096cb9c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:17 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:17 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:17 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:17 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:17 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:17 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3e4bf7-ed0e-4df0-ba75-aff1d752e9e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2, portal: 172.16.0.220,3260]
Aug 15 02:02:18 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:18 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c382a44-a7f8-41ae-8156-62362efc3f01]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3dc511-f817-4777-bab8-4235faf8d3f2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:18 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:18 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:18 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:18 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:18 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:18 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:18 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:18 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9da9dd-4972-4af4-ad69-4688e7aec2af]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqCStXxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG nova.compute.manager [req-c25f428b-0164-4b61-821d-f906da595f94 req-cd81f98e-4788-447b-93bb-4025ad7fb09b service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received event network-vif-plugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c25f428b-0164-4b61-821d-f906da595f94 req-cd81f98e-4788-447b-93bb-4025ad7fb09b service nova] Acquiring lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c25f428b-0164-4b61-821d-f906da595f94 req-cd81f98e-4788-447b-93bb-4025ad7fb09b service nova] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c25f428b-0164-4b61-821d-f906da595f94 req-cd81f98e-4788-447b-93bb-4025ad7fb09b service nova] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG nova.compute.manager [req-c25f428b-0164-4b61-821d-f906da595f94 req-cd81f98e-4788-447b-93bb-4025ad7fb09b service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] No waiting events found dispatching network-vif-plugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:19 user nova-compute[73121]: WARNING nova.compute.manager [req-c25f428b-0164-4b61-821d-f906da595f94 req-cd81f98e-4788-447b-93bb-4025ad7fb09b service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received unexpected event network-vif-plugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 for instance with vm_state building and task_state spawning.
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] <== connect_volume: return (3058ms) {'type': 'block', 'scsi_wwn': '23332623261616164', 'path': '/dev/sde'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332623261616164', 'path': '/dev/sde'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.292s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:19 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:19 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03b9468-dc3d-4fe5-b5c3-7035670c7f43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:19 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTldYufj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:19 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f429d9-1b45-4e63-a8cd-c0c8643383bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2] added
Aug 15 02:02:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f357bf85-4034-44e2-9933-02723da77f71]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3cd8ed-8d01-4440-8b06-ec87273e0466]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLlzyWfZ {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLlzyWfZ" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3b7a87-289f-47b2-87d8-2a0ad13efd8e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wLlzyWfZ'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b395fbd-b925-4c1c-b469-e2e8c5edabe0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec726ab2-b829-466d-ab35-a33a48b7e63a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0a03d9-7f44-4e37-b43a-fa354f5be80c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2, portal: 172.16.0.220,3260]
Aug 15 02:02:19 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b530f2-447f-4d0e-9ca9-e47c7eecfb8f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[333ad01a-dc0c-4a5a-a987-4f449adf2bd4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f841b7ca-d0d6-4176-949d-686d6b052d88]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLlzyWfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "78cda252-7cca-412c-ac97-24fc375d32de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lazy-loading 'flavor' on Instance uuid 78cda252-7cca-412c-ac97-24fc375d32de {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "78cda252-7cca-412c-ac97-24fc375d32de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:20 user nova-compute[73121]: INFO nova.compute.manager [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Attaching volume 937c51d2-f741-4657-89f8-987fad6700a5 to /dev/vdb
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.utils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[48003504-83a1-45c6-9540-997fb611a231]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fcc72b-36ad-4d0c-8f45-ec16a134d3b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3239cf0c-ecf8-42a5-860e-3ce4407ba2ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[149c284c-8bd7-41ee-adbd-8c95764d7df7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:20 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f0f2f9-5d00-4296-91fc-a544ae10ba17]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.utils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Updating existing volume attachment record: 36d4ac73-8bc3-48b7-98c8-333df709327b {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] <== connect_volume: return (2648ms) {'type': 'block', 'scsi_wwn': '26232396564313239', 'path': '/dev/sdf'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232396564313239', 'path': '/dev/sdf'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.314s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:20 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:20 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c77d51-6d5b-4ce3-b00f-a51f28b85ec4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:20 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xfRrkYGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:20 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c63770-53d1-4cb8-bd72-8508917792aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054] added
Aug 15 02:02:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d7a90a-85f4-46a9-8cec-caf53afe68e5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1a20ec-1a9e-4660-97c9-1527a471c609]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTldYufj {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTldYufj" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dc8374-94e6-450d-a887-14885d099609]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iTldYufj'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2e6523-4963-4568-b92f-8c5d849e669a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[989deb0f-5eb9-4155-aba2-448667e03b82]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a96bd3-3127-405c-834b-628ce151d077]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054, portal: 172.16.0.220,3260]
Aug 15 02:02:20 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef767799-ade7-46eb-87b5-aabc30155510]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5fc601-1d36-4891-a1ae-0533a8a0e0b8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba251c1-860d-408c-ad3d-991b4060bcd9]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTldYufj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:20 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064940.9939315, 8404c6b1-afcf-4362-a767-f3c18d50ebf0 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:02:20 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] VM Resumed (Lifecycle Event)
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:02:21 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Instance spawned successfully.
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.compute.manager [req-77b9c076-d9b3-46d9-b798-769b2e879cfc req-abb750c2-9231-4a5a-bd86-6f80418033c6 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received event network-vif-plugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-77b9c076-d9b3-46d9-b798-769b2e879cfc req-abb750c2-9231-4a5a-bd86-6f80418033c6 service nova] Acquiring lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-77b9c076-d9b3-46d9-b798-769b2e879cfc req-abb750c2-9231-4a5a-bd86-6f80418033c6 service nova] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-77b9c076-d9b3-46d9-b798-769b2e879cfc req-abb750c2-9231-4a5a-bd86-6f80418033c6 service nova] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.compute.manager [req-77b9c076-d9b3-46d9-b798-769b2e879cfc req-abb750c2-9231-4a5a-bd86-6f80418033c6 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] No waiting events found dispatching network-vif-plugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:21 user nova-compute[73121]: WARNING nova.compute.manager [req-77b9c076-d9b3-46d9-b798-769b2e879cfc req-abb750c2-9231-4a5a-bd86-6f80418033c6 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received unexpected event network-vif-plugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 for instance with vm_state building and task_state spawning.
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:21 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064940.9944894, 8404c6b1-afcf-4362-a767-f3c18d50ebf0 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:02:21 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] VM Started (Lifecycle Event)
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:02:21 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:02:21 user nova-compute[73121]: INFO nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:21 user nova-compute[73121]: INFO nova.compute.manager [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Took 7.35 seconds to build instance.
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9855b8e2-a60b-4b21-99c0-0b74050bc3cf tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.468s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] <== connect_volume: return (2642ms) {'type': 'block', 'scsi_wwn': '23536343634626335', 'path': '/dev/sdg'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536343634626335', 'path': '/dev/sdg'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.292s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:21 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:21 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c546d69-e5d3-43fb-8f5e-4ca159d1e690]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:21 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2b:35,bridge_name='br-int',has_traffic_filtering=True,id=63b8a051-1128-4b55-bc00-de6e0375820f,network=Network(c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b8a051-11') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:69,bridge_name='br-int',has_traffic_filtering=True,id=f0f11527-ae15-42d4-98d6-74c2d031efe1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0f11527-ae') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:9c:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2f84e08-dc37-4478-916a-8d3a90d8b298,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2f84e08-dc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c5c-51d2-4e94-9588-10dcd56ff249,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c5c-51') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=6de97b6c-9106-49f3-b959-ef35cb48c6a1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de97b6c-91') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=bddc610c-078b-4886-b60d-df61562e4852,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddc610c-07') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:85:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e3b9c4d-df3e-4d98-840d-9cc5d4124126,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3b9c4d-df') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lazy-loading 'pci_devices' on Instance uuid 3626675d-6ed7-400c-998f-67501a107da3 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d726363-63d0-4bcb-85e0-5344e549fc16]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1] added
Aug 15 02:02:21 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:02:21 user nova-compute[73121]:   <uuid>3626675d-6ed7-400c-998f-67501a107da3</uuid>
Aug 15 02:02:21 user nova-compute[73121]:   <name>instance-0000000b</name>
Aug 15 02:02:21 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:02:21 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:02:21 user nova-compute[73121]:   <metadata>
Aug 15 02:02:21 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:02:21 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:02:21 user nova-compute[73121]:       <nova:name>tempest-device-tagging-server-1140277994</nova:name>
Aug 15 02:02:21 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:02:14</nova:creationTime>
Aug 15 02:02:21 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:02:21 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:02:21 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:02:21 user nova-compute[73121]:       <nova:owner>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:user uuid="0d2668ffb2e04520b8a4e582afa747a3">tempest-TaggedBootDevicesTest_v242-1839950291-project-member</nova:user>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:project uuid="14b2d4d29f2e48258adf11773b32df1e">tempest-TaggedBootDevicesTest_v242-1839950291</nova:project>
Aug 15 02:02:21 user nova-compute[73121]:       </nova:owner>
Aug 15 02:02:21 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:02:21 user nova-compute[73121]:       <nova:ports>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:port uuid="63b8a051-1128-4b55-bc00-de6e0375820f">
Aug 15 02:02:21 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 02:02:21 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:port uuid="f0f11527-ae15-42d4-98d6-74c2d031efe1">
Aug 15 02:02:21 user nova-compute[73121]:           <nova:ip type="fixed" address="10.1.1.59" ipVersion="4"/>
Aug 15 02:02:21 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:port uuid="f2f84e08-dc37-4478-916a-8d3a90d8b298">
Aug 15 02:02:21 user nova-compute[73121]:           <nova:ip type="fixed" address="10.1.1.146" ipVersion="4"/>
Aug 15 02:02:21 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:port uuid="5e6c3c5c-51d2-4e94-9588-10dcd56ff249">
Aug 15 02:02:21 user nova-compute[73121]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Aug 15 02:02:21 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:port uuid="6de97b6c-9106-49f3-b959-ef35cb48c6a1">
Aug 15 02:02:21 user nova-compute[73121]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Aug 15 02:02:21 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:port uuid="bddc610c-078b-4886-b60d-df61562e4852">
Aug 15 02:02:21 user nova-compute[73121]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 02:02:21 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:21 user nova-compute[73121]:         <nova:port uuid="5e3b9c4d-df3e-4d98-840d-9cc5d4124126">
Aug 15 02:02:21 user nova-compute[73121]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 02:02:21 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:21 user nova-compute[73121]:       </nova:ports>
Aug 15 02:02:21 user nova-compute[73121]:     </nova:instance>
Aug 15 02:02:21 user nova-compute[73121]:   </metadata>
Aug 15 02:02:21 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:02:21 user nova-compute[73121]:     <system>
Aug 15 02:02:21 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:02:21 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:02:21 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:02:21 user nova-compute[73121]:       <entry name="serial">3626675d-6ed7-400c-998f-67501a107da3</entry>
Aug 15 02:02:21 user nova-compute[73121]:       <entry name="uuid">3626675d-6ed7-400c-998f-67501a107da3</entry>
Aug 15 02:02:21 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:02:21 user nova-compute[73121]:     </system>
Aug 15 02:02:21 user nova-compute[73121]:   </sysinfo>
Aug 15 02:02:21 user nova-compute[73121]:   <os>
Aug 15 02:02:21 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:02:21 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:02:21 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:02:21 user nova-compute[73121]:   </os>
Aug 15 02:02:21 user nova-compute[73121]:   <features>
Aug 15 02:02:21 user nova-compute[73121]:     <acpi/>
Aug 15 02:02:21 user nova-compute[73121]:     <apic/>
Aug 15 02:02:21 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:02:21 user nova-compute[73121]:   </features>
Aug 15 02:02:21 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:02:21 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:02:21 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:02:21 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:02:21 user nova-compute[73121]:   </clock>
Aug 15 02:02:21 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:02:21 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:02:21 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:02:21 user nova-compute[73121]:   </cpu>
Aug 15 02:02:21 user nova-compute[73121]:   <devices>
Aug 15 02:02:21 user nova-compute[73121]:     <disk type="file" device="cdrom">
Aug 15 02:02:21 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 02:02:21 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/3626675d-6ed7-400c-998f-67501a107da3/disk.config"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="hda" bus="ide"/>
Aug 15 02:02:21 user nova-compute[73121]:     </disk>
Aug 15 02:02:21 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:02:21 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:02:21 user nova-compute[73121]:       <source dev="/dev/sdc"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <serial>ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf</serial>
Aug 15 02:02:21 user nova-compute[73121]:     </disk>
Aug 15 02:02:21 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:02:21 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:02:21 user nova-compute[73121]:       <source dev="/dev/sde"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <serial>2abc33a6-5dc9-45f9-937b-6022743a7ba2</serial>
Aug 15 02:02:21 user nova-compute[73121]:     </disk>
Aug 15 02:02:21 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:02:21 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:02:21 user nova-compute[73121]:       <source dev="/dev/sdg"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="vdc" bus="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <serial>5a0dad82-dc1b-48aa-86d3-f3d48c2c5054</serial>
Aug 15 02:02:21 user nova-compute[73121]:     </disk>
Aug 15 02:02:21 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:21 user nova-compute[73121]:       <mac address="fa:16:3e:90:2b:35"/>
Aug 15 02:02:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="tap63b8a051-11"/>
Aug 15 02:02:21 user nova-compute[73121]:     </interface>
Aug 15 02:02:21 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:21 user nova-compute[73121]:       <mac address="fa:16:3e:98:ce:69"/>
Aug 15 02:02:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="tapf0f11527-ae"/>
Aug 15 02:02:21 user nova-compute[73121]:     </interface>
Aug 15 02:02:21 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:21 user nova-compute[73121]:       <mac address="fa:16:3e:24:9c:4b"/>
Aug 15 02:02:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="tapf2f84e08-dc"/>
Aug 15 02:02:21 user nova-compute[73121]:     </interface>
Aug 15 02:02:21 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:21 user nova-compute[73121]:       <mac address="fa:16:3e:c4:02:33"/>
Aug 15 02:02:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="tap5e6c3c5c-51"/>
Aug 15 02:02:21 user nova-compute[73121]:     </interface>
Aug 15 02:02:21 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:21 user nova-compute[73121]:       <mac address="fa:16:3e:fa:8f:96"/>
Aug 15 02:02:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="tap6de97b6c-91"/>
Aug 15 02:02:21 user nova-compute[73121]:     </interface>
Aug 15 02:02:21 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:21 user nova-compute[73121]:       <mac address="fa:16:3e:1b:0a:20"/>
Aug 15 02:02:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="tapbddc610c-07"/>
Aug 15 02:02:21 user nova-compute[73121]:     </interface>
Aug 15 02:02:21 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:21 user nova-compute[73121]:       <mac address="fa:16:3e:94:85:8b"/>
Aug 15 02:02:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:21 user nova-compute[73121]:       <target dev="tap5e3b9c4d-df"/>
Aug 15 02:02:21 user nova-compute[73121]:     </interface>
Aug 15 02:02:21 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:02:21 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/3626675d-6ed7-400c-998f-67501a107da3/console.log" append="off"/>
Aug 15 02:02:21 user nova-compute[73121]:     </serial>
Aug 15 02:02:21 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:02:21 user nova-compute[73121]:     <video>
Aug 15 02:02:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:21 user nova-compute[73121]:     </video>
Aug 15 02:02:21 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:02:21 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:02:21 user nova-compute[73121]:     </rng>
Aug 15 02:02:21 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:02:21 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:02:21 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:02:21 user nova-compute[73121]:     </memballoon>
Aug 15 02:02:21 user nova-compute[73121]:   </devices>
Aug 15 02:02:21 user nova-compute[73121]: </domain>
Aug 15 02:02:21 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:2b:35,bridge_name='br-int',has_traffic_filtering=True,id=63b8a051-1128-4b55-bc00-de6e0375820f,network=Network(c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b8a051-11') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2b:35,bridge_name='br-int',has_traffic_filtering=True,id=63b8a051-1128-4b55-bc00-de6e0375820f,network=Network(c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b8a051-11') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f977ade9-860f-4e77-8f35-df839366bfe0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63b8a051-11, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63b8a051-11, col_values=(('external_ids', {'iface-id': '63b8a051-1128-4b55-bc00-de6e0375820f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:2b:35', 'vm-uuid': '3626675d-6ed7-400c-998f-67501a107da3'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: INFO os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:2b:35,bridge_name='br-int',has_traffic_filtering=True,id=63b8a051-1128-4b55-bc00-de6e0375820f,network=Network(c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b8a051-11')
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:69,bridge_name='br-int',has_traffic_filtering=True,id=f0f11527-ae15-42d4-98d6-74c2d031efe1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0f11527-ae') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:69,bridge_name='br-int',has_traffic_filtering=True,id=f0f11527-ae15-42d4-98d6-74c2d031efe1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0f11527-ae') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a05101-1516-46b3-ba29-6e21157fc07e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xfRrkYGq {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0f11527-ae, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0f11527-ae, col_values=(('external_ids', {'iface-id': 'f0f11527-ae15-42d4-98d6-74c2d031efe1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:ce:69', 'vm-uuid': '3626675d-6ed7-400c-998f-67501a107da3'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xfRrkYGq" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[420bcadb-bb68-4424-9b33-3a6f8e346d0f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xfRrkYGq'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: INFO os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:69,bridge_name='br-int',has_traffic_filtering=True,id=f0f11527-ae15-42d4-98d6-74c2d031efe1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0f11527-ae')
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:9c:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2f84e08-dc37-4478-916a-8d3a90d8b298,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2f84e08-dc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:9c:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2f84e08-dc37-4478-916a-8d3a90d8b298,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2f84e08-dc') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2f84e08-dc, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2f84e08-dc, col_values=(('external_ids', {'iface-id': 'f2f84e08-dc37-4478-916a-8d3a90d8b298', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:9c:4b', 'vm-uuid': '3626675d-6ed7-400c-998f-67501a107da3'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[951c716e-b9eb-490e-832f-e2f01770f4db]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: INFO os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:9c:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2f84e08-dc37-4478-916a-8d3a90d8b298,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2f84e08-dc')
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c5c-51d2-4e94-9588-10dcd56ff249,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c5c-51') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c5c-51d2-4e94-9588-10dcd56ff249,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c5c-51') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2b7b00-11f5-4234-87db-8da8184946d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e6c3c5c-51, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e6c3c5c-51, col_values=(('external_ids', {'iface-id': '5e6c3c5c-51d2-4e94-9588-10dcd56ff249', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:02:33', 'vm-uuid': '3626675d-6ed7-400c-998f-67501a107da3'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: INFO os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c5c-51d2-4e94-9588-10dcd56ff249,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c5c-51')
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=6de97b6c-9106-49f3-b959-ef35cb48c6a1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de97b6c-91') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=6de97b6c-9106-49f3-b959-ef35cb48c6a1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de97b6c-91') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6de97b6c-91, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6de97b6c-91, col_values=(('external_ids', {'iface-id': '6de97b6c-9106-49f3-b959-ef35cb48c6a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:8f:96', 'vm-uuid': '3626675d-6ed7-400c-998f-67501a107da3'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc2230f-dd83-4ae0-a959-b1db45632979]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1, portal: 172.16.0.220,3260]
Aug 15 02:02:22 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[285d4fde-be18-45e6-8deb-7811efabac01]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: INFO os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=6de97b6c-9106-49f3-b959-ef35cb48c6a1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de97b6c-91')
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=bddc610c-078b-4886-b60d-df61562e4852,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddc610c-07') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=bddc610c-078b-4886-b60d-df61562e4852,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddc610c-07') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbddc610c-07, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbddc610c-07, col_values=(('external_ids', {'iface-id': 'bddc610c-078b-4886-b60d-df61562e4852', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:0a:20', 'vm-uuid': '3626675d-6ed7-400c-998f-67501a107da3'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a984fd2-8549-4b54-a352-223b048e90ae]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4525eda5-82e2-4051-a710-6be22a9b89e8]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xfRrkYGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: INFO os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=bddc610c-078b-4886-b60d-df61562e4852,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddc610c-07')
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:85:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e3b9c4d-df3e-4d98-840d-9cc5d4124126,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3b9c4d-df') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:85:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e3b9c4d-df3e-4d98-840d-9cc5d4124126,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3b9c4d-df') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e3b9c4d-df, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e3b9c4d-df, col_values=(('external_ids', {'iface-id': '5e3b9c4d-df3e-4d98-840d-9cc5d4124126', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:85:8b', 'vm-uuid': '3626675d-6ed7-400c-998f-67501a107da3'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:22 user nova-compute[73121]: INFO os_vif [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:85:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e3b9c4d-df3e-4d98-840d-9cc5d4124126,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3b9c4d-df')
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] No BDM found with device name hda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] No VIF found with MAC fa:16:3e:90:2b:35, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] No VIF found with MAC fa:16:3e:fa:8f:96, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:02:22 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Using config drive
Aug 15 02:02:22 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Creating config drive at /opt/stack/data/nova/instances/3626675d-6ed7-400c-998f-67501a107da3/disk.config
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3626675d-6ed7-400c-998f-67501a107da3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqt8w162i {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3626675d-6ed7-400c-998f-67501a107da3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqt8w162i" returned: 0 in 0.057s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] <== connect_volume: return (2680ms) {'type': 'block', 'scsi_wwn': '26532306133306330', 'path': '/dev/sdh'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532306133306330', 'path': '/dev/sdh'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=204821bd-61e9-471a-b225-84018c93b370,network=Network(3ed87f81-1036-4454-92c2-1f688c0d8676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204821bd-61') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:e7,bridge_name='br-int',has_traffic_filtering=True,id=c1a3db14-7ef4-4d41-8476-38b88f4e62c9,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a3db14-7e') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:58:50,bridge_name='br-int',has_traffic_filtering=True,id=6f68bad0-3cde-4382-b499-61d134c3fbce,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f68bad0-3c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:79:28,bridge_name='br-int',has_traffic_filtering=True,id=e86be087-dc7e-4a04-b8f9-0dc60caa9bc0,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86be087-dc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=1785fd4a-8241-4c47-9f08-925c7fc16480,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1785fd4a-82') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a4:0d,bridge_name='br-int',has_traffic_filtering=True,id=8d9efae5-16d3-48bb-b65b-fd44b2cebc26,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9efae5-16') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:af:4e,bridge_name='br-int',has_traffic_filtering=True,id=39cfe07e-3541-48b9-8b3e-4cbe3817bdc7,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39cfe07e-35') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lazy-loading 'pci_devices' on Instance uuid b14c5889-916d-43cf-8faa-4373a5703c84 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:02:23 user nova-compute[73121]:   <uuid>b14c5889-916d-43cf-8faa-4373a5703c84</uuid>
Aug 15 02:02:23 user nova-compute[73121]:   <name>instance-0000000c</name>
Aug 15 02:02:23 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:02:23 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:02:23 user nova-compute[73121]:   <metadata>
Aug 15 02:02:23 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:02:23 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:02:23 user nova-compute[73121]:       <nova:name>tempest-device-tagging-server-191343971</nova:name>
Aug 15 02:02:23 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:02:15</nova:creationTime>
Aug 15 02:02:23 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:02:23 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:02:23 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:02:23 user nova-compute[73121]:       <nova:owner>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:user uuid="efee72a4c2b24e7fb19b58f6a26e173c">tempest-TaggedBootDevicesTest-1162132718-project-member</nova:user>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:project uuid="bf24913e47a44edfa2f7105cda66cefa">tempest-TaggedBootDevicesTest-1162132718</nova:project>
Aug 15 02:02:23 user nova-compute[73121]:       </nova:owner>
Aug 15 02:02:23 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:02:23 user nova-compute[73121]:       <nova:ports>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:port uuid="204821bd-61e9-471a-b225-84018c93b370">
Aug 15 02:02:23 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 02:02:23 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:port uuid="c1a3db14-7ef4-4d41-8476-38b88f4e62c9">
Aug 15 02:02:23 user nova-compute[73121]:           <nova:ip type="fixed" address="10.1.1.101" ipVersion="4"/>
Aug 15 02:02:23 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:port uuid="6f68bad0-3cde-4382-b499-61d134c3fbce">
Aug 15 02:02:23 user nova-compute[73121]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Aug 15 02:02:23 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:port uuid="e86be087-dc7e-4a04-b8f9-0dc60caa9bc0">
Aug 15 02:02:23 user nova-compute[73121]:           <nova:ip type="fixed" address="10.1.1.141" ipVersion="4"/>
Aug 15 02:02:23 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:port uuid="1785fd4a-8241-4c47-9f08-925c7fc16480">
Aug 15 02:02:23 user nova-compute[73121]:           <nova:ip type="fixed" address="10.1.1.199" ipVersion="4"/>
Aug 15 02:02:23 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:port uuid="8d9efae5-16d3-48bb-b65b-fd44b2cebc26">
Aug 15 02:02:23 user nova-compute[73121]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 02:02:23 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:23 user nova-compute[73121]:         <nova:port uuid="39cfe07e-3541-48b9-8b3e-4cbe3817bdc7">
Aug 15 02:02:23 user nova-compute[73121]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 02:02:23 user nova-compute[73121]:         </nova:port>
Aug 15 02:02:23 user nova-compute[73121]:       </nova:ports>
Aug 15 02:02:23 user nova-compute[73121]:     </nova:instance>
Aug 15 02:02:23 user nova-compute[73121]:   </metadata>
Aug 15 02:02:23 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:02:23 user nova-compute[73121]:     <system>
Aug 15 02:02:23 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:02:23 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:02:23 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:02:23 user nova-compute[73121]:       <entry name="serial">b14c5889-916d-43cf-8faa-4373a5703c84</entry>
Aug 15 02:02:23 user nova-compute[73121]:       <entry name="uuid">b14c5889-916d-43cf-8faa-4373a5703c84</entry>
Aug 15 02:02:23 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:02:23 user nova-compute[73121]:     </system>
Aug 15 02:02:23 user nova-compute[73121]:   </sysinfo>
Aug 15 02:02:23 user nova-compute[73121]:   <os>
Aug 15 02:02:23 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:02:23 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:02:23 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:02:23 user nova-compute[73121]:   </os>
Aug 15 02:02:23 user nova-compute[73121]:   <features>
Aug 15 02:02:23 user nova-compute[73121]:     <acpi/>
Aug 15 02:02:23 user nova-compute[73121]:     <apic/>
Aug 15 02:02:23 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:02:23 user nova-compute[73121]:   </features>
Aug 15 02:02:23 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:02:23 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:02:23 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:02:23 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:02:23 user nova-compute[73121]:   </clock>
Aug 15 02:02:23 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:02:23 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:02:23 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:02:23 user nova-compute[73121]:   </cpu>
Aug 15 02:02:23 user nova-compute[73121]:   <devices>
Aug 15 02:02:23 user nova-compute[73121]:     <disk type="file" device="cdrom">
Aug 15 02:02:23 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 02:02:23 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/b14c5889-916d-43cf-8faa-4373a5703c84/disk.config"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="hda" bus="ide"/>
Aug 15 02:02:23 user nova-compute[73121]:     </disk>
Aug 15 02:02:23 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:02:23 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:02:23 user nova-compute[73121]:       <source dev="/dev/sdd"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <serial>60eafcfc-720b-4f84-820b-9f2d15c593be</serial>
Aug 15 02:02:23 user nova-compute[73121]:     </disk>
Aug 15 02:02:23 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:02:23 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:02:23 user nova-compute[73121]:       <source dev="/dev/sdf"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <serial>56e32cd2-362c-4d9e-b710-91db0185f1c2</serial>
Aug 15 02:02:23 user nova-compute[73121]:     </disk>
Aug 15 02:02:23 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:02:23 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:02:23 user nova-compute[73121]:       <source dev="/dev/sdh"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="vdc" bus="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <serial>06278906-6755-4ee9-bb24-233af1e6e8b1</serial>
Aug 15 02:02:23 user nova-compute[73121]:     </disk>
Aug 15 02:02:23 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:23 user nova-compute[73121]:       <mac address="fa:16:3e:44:39:d2"/>
Aug 15 02:02:23 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="tap204821bd-61"/>
Aug 15 02:02:23 user nova-compute[73121]:     </interface>
Aug 15 02:02:23 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:23 user nova-compute[73121]:       <mac address="fa:16:3e:71:c6:e7"/>
Aug 15 02:02:23 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="tapc1a3db14-7e"/>
Aug 15 02:02:23 user nova-compute[73121]:     </interface>
Aug 15 02:02:23 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:23 user nova-compute[73121]:       <mac address="fa:16:3e:90:58:50"/>
Aug 15 02:02:23 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="tap6f68bad0-3c"/>
Aug 15 02:02:23 user nova-compute[73121]:     </interface>
Aug 15 02:02:23 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:23 user nova-compute[73121]:       <mac address="fa:16:3e:2e:79:28"/>
Aug 15 02:02:23 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="tape86be087-dc"/>
Aug 15 02:02:23 user nova-compute[73121]:     </interface>
Aug 15 02:02:23 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:23 user nova-compute[73121]:       <mac address="fa:16:3e:87:88:d0"/>
Aug 15 02:02:23 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="tap1785fd4a-82"/>
Aug 15 02:02:23 user nova-compute[73121]:     </interface>
Aug 15 02:02:23 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:23 user nova-compute[73121]:       <mac address="fa:16:3e:ef:a4:0d"/>
Aug 15 02:02:23 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="tap8d9efae5-16"/>
Aug 15 02:02:23 user nova-compute[73121]:     </interface>
Aug 15 02:02:23 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:02:23 user nova-compute[73121]:       <mac address="fa:16:3e:ea:af:4e"/>
Aug 15 02:02:23 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:02:23 user nova-compute[73121]:       <target dev="tap39cfe07e-35"/>
Aug 15 02:02:23 user nova-compute[73121]:     </interface>
Aug 15 02:02:23 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:02:23 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/b14c5889-916d-43cf-8faa-4373a5703c84/console.log" append="off"/>
Aug 15 02:02:23 user nova-compute[73121]:     </serial>
Aug 15 02:02:23 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:02:23 user nova-compute[73121]:     <video>
Aug 15 02:02:23 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:02:23 user nova-compute[73121]:     </video>
Aug 15 02:02:23 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:02:23 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:02:23 user nova-compute[73121]:     </rng>
Aug 15 02:02:23 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:02:23 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:02:23 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:02:23 user nova-compute[73121]:     </memballoon>
Aug 15 02:02:23 user nova-compute[73121]:   </devices>
Aug 15 02:02:23 user nova-compute[73121]: </domain>
Aug 15 02:02:23 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=204821bd-61e9-471a-b225-84018c93b370,network=Network(3ed87f81-1036-4454-92c2-1f688c0d8676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204821bd-61') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=204821bd-61e9-471a-b225-84018c93b370,network=Network(3ed87f81-1036-4454-92c2-1f688c0d8676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204821bd-61') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap204821bd-61, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap204821bd-61, col_values=(('external_ids', {'iface-id': '204821bd-61e9-471a-b225-84018c93b370', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:39:d2', 'vm-uuid': 'b14c5889-916d-43cf-8faa-4373a5703c84'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: INFO os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=204821bd-61e9-471a-b225-84018c93b370,network=Network(3ed87f81-1036-4454-92c2-1f688c0d8676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204821bd-61')
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:e7,bridge_name='br-int',has_traffic_filtering=True,id=c1a3db14-7ef4-4d41-8476-38b88f4e62c9,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a3db14-7e') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:e7,bridge_name='br-int',has_traffic_filtering=True,id=c1a3db14-7ef4-4d41-8476-38b88f4e62c9,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a3db14-7e') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1a3db14-7e, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1a3db14-7e, col_values=(('external_ids', {'iface-id': 'c1a3db14-7ef4-4d41-8476-38b88f4e62c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:c6:e7', 'vm-uuid': 'b14c5889-916d-43cf-8faa-4373a5703c84'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: INFO os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:e7,bridge_name='br-int',has_traffic_filtering=True,id=c1a3db14-7ef4-4d41-8476-38b88f4e62c9,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a3db14-7e')
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:58:50,bridge_name='br-int',has_traffic_filtering=True,id=6f68bad0-3cde-4382-b499-61d134c3fbce,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f68bad0-3c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:58:50,bridge_name='br-int',has_traffic_filtering=True,id=6f68bad0-3cde-4382-b499-61d134c3fbce,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f68bad0-3c') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6f68bad0-3c, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6f68bad0-3c, col_values=(('external_ids', {'iface-id': '6f68bad0-3cde-4382-b499-61d134c3fbce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:58:50', 'vm-uuid': 'b14c5889-916d-43cf-8faa-4373a5703c84'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: INFO os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:58:50,bridge_name='br-int',has_traffic_filtering=True,id=6f68bad0-3cde-4382-b499-61d134c3fbce,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f68bad0-3c')
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:79:28,bridge_name='br-int',has_traffic_filtering=True,id=e86be087-dc7e-4a04-b8f9-0dc60caa9bc0,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86be087-dc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:79:28,bridge_name='br-int',has_traffic_filtering=True,id=e86be087-dc7e-4a04-b8f9-0dc60caa9bc0,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86be087-dc') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape86be087-dc, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape86be087-dc, col_values=(('external_ids', {'iface-id': 'e86be087-dc7e-4a04-b8f9-0dc60caa9bc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:79:28', 'vm-uuid': 'b14c5889-916d-43cf-8faa-4373a5703c84'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: INFO os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:79:28,bridge_name='br-int',has_traffic_filtering=True,id=e86be087-dc7e-4a04-b8f9-0dc60caa9bc0,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86be087-dc')
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=1785fd4a-8241-4c47-9f08-925c7fc16480,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1785fd4a-82') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=1785fd4a-8241-4c47-9f08-925c7fc16480,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1785fd4a-82') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1785fd4a-82, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1785fd4a-82, col_values=(('external_ids', {'iface-id': '1785fd4a-8241-4c47-9f08-925c7fc16480', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:88:d0', 'vm-uuid': 'b14c5889-916d-43cf-8faa-4373a5703c84'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: INFO os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=1785fd4a-8241-4c47-9f08-925c7fc16480,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1785fd4a-82')
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a4:0d,bridge_name='br-int',has_traffic_filtering=True,id=8d9efae5-16d3-48bb-b65b-fd44b2cebc26,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9efae5-16') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a4:0d,bridge_name='br-int',has_traffic_filtering=True,id=8d9efae5-16d3-48bb-b65b-fd44b2cebc26,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9efae5-16') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d9efae5-16, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d9efae5-16, col_values=(('external_ids', {'iface-id': '8d9efae5-16d3-48bb-b65b-fd44b2cebc26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:a4:0d', 'vm-uuid': 'b14c5889-916d-43cf-8faa-4373a5703c84'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: INFO os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a4:0d,bridge_name='br-int',has_traffic_filtering=True,id=8d9efae5-16d3-48bb-b65b-fd44b2cebc26,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9efae5-16')
Aug 15 02:02:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:01:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:af:4e,bridge_name='br-int',has_traffic_filtering=True,id=39cfe07e-3541-48b9-8b3e-4cbe3817bdc7,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39cfe07e-35') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:af:4e,bridge_name='br-int',has_traffic_filtering=True,id=39cfe07e-3541-48b9-8b3e-4cbe3817bdc7,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39cfe07e-35') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39cfe07e-35, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39cfe07e-35, col_values=(('external_ids', {'iface-id': '39cfe07e-3541-48b9-8b3e-4cbe3817bdc7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:af:4e', 'vm-uuid': 'b14c5889-916d-43cf-8faa-4373a5703c84'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG nova.compute.manager [req-61426a2d-c4fd-4119-a7a6-ab6718e67037 req-29986d54-cf2a-480c-aac4-166372e876be service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-61426a2d-c4fd-4119-a7a6-ab6718e67037 req-29986d54-cf2a-480c-aac4-166372e876be service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-61426a2d-c4fd-4119-a7a6-ab6718e67037 req-29986d54-cf2a-480c-aac4-166372e876be service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-61426a2d-c4fd-4119-a7a6-ab6718e67037 req-29986d54-cf2a-480c-aac4-166372e876be service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG nova.compute.manager [req-61426a2d-c4fd-4119-a7a6-ab6718e67037 req-29986d54-cf2a-480c-aac4-166372e876be service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:24 user nova-compute[73121]: WARNING nova.compute.manager [req-61426a2d-c4fd-4119-a7a6-ab6718e67037 req-29986d54-cf2a-480c-aac4-166372e876be service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-63b8a051-1128-4b55-bc00-de6e0375820f for instance with vm_state building and task_state spawning.
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: INFO os_vif [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:af:4e,bridge_name='br-int',has_traffic_filtering=True,id=39cfe07e-3541-48b9-8b3e-4cbe3817bdc7,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39cfe07e-35')
Aug 15 02:02:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] No BDM found with device name hda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] No VIF found with MAC fa:16:3e:44:39:d2, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] No VIF found with MAC fa:16:3e:87:88:d0, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:02:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Using config drive
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Creating config drive at /opt/stack/data/nova/instances/b14c5889-916d-43cf-8faa-4373a5703c84/disk.config
Aug 15 02:02:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b14c5889-916d-43cf-8faa-4373a5703c84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl8qtxn3v {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b14c5889-916d-43cf-8faa-4373a5703c84/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpl8qtxn3v" returned: 0 in 0.071s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6831d8f-8ca6-4753-af38-2046b2d86f4f req-d1656ae6-afcb-4fc7-93d1-4a111cce5dcb service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6831d8f-8ca6-4753-af38-2046b2d86f4f req-d1656ae6-afcb-4fc7-93d1-4a111cce5dcb service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6831d8f-8ca6-4753-af38-2046b2d86f4f req-d1656ae6-afcb-4fc7-93d1-4a111cce5dcb service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6831d8f-8ca6-4753-af38-2046b2d86f4f req-d1656ae6-afcb-4fc7-93d1-4a111cce5dcb service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6831d8f-8ca6-4753-af38-2046b2d86f4f req-d1656ae6-afcb-4fc7-93d1-4a111cce5dcb service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:25 user nova-compute[73121]: WARNING nova.compute.manager [req-e6831d8f-8ca6-4753-af38-2046b2d86f4f req-d1656ae6-afcb-4fc7-93d1-4a111cce5dcb service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 for instance with vm_state building and task_state spawning.
Aug 15 02:02:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-e3ec4810-fda5-45ef-ab9a-0576647c020f req-1799f6f8-00fa-4bc4-b947-29d013f281c6 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e3ec4810-fda5-45ef-ab9a-0576647c020f req-1799f6f8-00fa-4bc4-b947-29d013f281c6 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e3ec4810-fda5-45ef-ab9a-0576647c020f req-1799f6f8-00fa-4bc4-b947-29d013f281c6 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e3ec4810-fda5-45ef-ab9a-0576647c020f req-1799f6f8-00fa-4bc4-b947-29d013f281c6 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-e3ec4810-fda5-45ef-ab9a-0576647c020f req-1799f6f8-00fa-4bc4-b947-29d013f281c6 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:25 user nova-compute[73121]: WARNING nova.compute.manager [req-e3ec4810-fda5-45ef-ab9a-0576647c020f req-1799f6f8-00fa-4bc4-b947-29d013f281c6 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 for instance with vm_state building and task_state spawning.
Aug 15 02:02:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:26 user nova-compute[73121]: WARNING nova.compute.manager [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-63b8a051-1128-4b55-bc00-de6e0375820f for instance with vm_state building and task_state spawning.
Aug 15 02:02:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:26 user nova-compute[73121]: WARNING nova.compute.manager [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 for instance with vm_state building and task_state spawning.
Aug 15 02:02:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:26 user nova-compute[73121]: WARNING nova.compute.manager [req-381c0d57-2d8c-435e-bf3f-af7b75b4cc49 req-3d3f5851-c840-475e-a9db-169e99e8d76f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 for instance with vm_state building and task_state spawning.
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:27 user nova-compute[73121]: WARNING nova.compute.manager [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 for instance with vm_state building and task_state spawning.
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:27 user nova-compute[73121]: WARNING nova.compute.manager [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 for instance with vm_state building and task_state spawning.
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:27 user nova-compute[73121]: WARNING nova.compute.manager [req-ef593d05-712f-40b6-ae6b-68202aaaafda req-ad92ee5c-24f9-4d85-a8b6-1279edef2e48 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 for instance with vm_state building and task_state spawning.
Aug 15 02:02:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:27 user nova-compute[73121]: WARNING nova.compute.manager [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 for instance with vm_state building and task_state spawning.
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:27 user nova-compute[73121]: WARNING nova.compute.manager [req-03604ae7-902b-4e78-9932-a99e3ab888b1 req-b23d3d7d-4efe-4769-9009-defb766ebe19 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-204821bd-61e9-471a-b225-84018c93b370 for instance with vm_state building and task_state spawning.
Aug 15 02:02:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:28 user nova-compute[73121]: WARNING nova.compute.manager [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 for instance with vm_state building and task_state spawning.
Aug 15 02:02:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:28 user nova-compute[73121]: WARNING nova.compute.manager [req-abf3c79d-2716-4d8b-92c1-100d90451138 req-1ea6f74d-00b5-4185-82a7-5bac6c0c8fbb service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 for instance with vm_state building and task_state spawning.
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUjcPaqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:28 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:28 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:28 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a5aa88-7328-487d-a9a9-474a32c310f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:28 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8f560a-adff-4a21-9a5b-e5f6db3cfa7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a] added
Aug 15 02:02:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1e07d5-e4f9-47f3-99b5-25b17c9708fb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac50c6b-8564-4054-93d3-a276b5695a55]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUjcPaqL {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUjcPaqL" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b53cda6-593a-494f-ab24-717cafeecb80]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lUjcPaqL'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5677f8e0-5bbd-40df-b573-18b11ce2851b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cefbe0b-8efb-4d27-89aa-5de35c2ef030]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[420dd34c-9726-4087-a25d-3d40566f8685]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260]
Aug 15 02:02:29 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:29 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[805ba0f9-9faf-4225-9da4-cbab9b97579d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:29 user nova-compute[73121]: WARNING nova.compute.manager [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-bddc610c-078b-4886-b60d-df61562e4852 for instance with vm_state building and task_state spawning.
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:29 user nova-compute[73121]: WARNING nova.compute.manager [req-2fac6e7f-7d4d-4716-bea3-4b4e736083cf req-fda60be9-b481-44c1-bcf4-c6449fc3b3e9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-bddc610c-078b-4886-b60d-df61562e4852 for instance with vm_state building and task_state spawning.
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d6f5c2-5e83-420c-9c13-078118b6bef4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:29 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:29 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:29 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.443s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[03162daa-045f-4957-acfc-58fa28634763]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUjcPaqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.008s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:29 user nova-compute[73121]: WARNING nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-204821bd-61e9-471a-b225-84018c93b370 for instance with vm_state building and task_state spawning.
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:29 user nova-compute[73121]: WARNING nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 for instance with vm_state building and task_state spawning.
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:29 user nova-compute[73121]: WARNING nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 for instance with vm_state building and task_state spawning.
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:29 user nova-compute[73121]: WARNING nova.compute.manager [req-ddb2491a-ef18-4852-924a-ba8a69a58a61 req-3dab54fd-7495-4865-9840-582bd95e093a service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 for instance with vm_state building and task_state spawning.
Aug 15 02:02:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== connect_volume: return (1494ms) {'type': 'block', 'scsi_wwn': '26632316239663535', 'path': '/dev/sdi'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632316239663535', 'path': '/dev/sdi'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:02:30 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:02:30 user nova-compute[73121]:   <source dev="/dev/sdi"/>
Aug 15 02:02:30 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:02:30 user nova-compute[73121]:   <serial>77a6f9a6-c8fa-429d-9c83-c270ccb11f5a</serial>
Aug 15 02:02:30 user nova-compute[73121]: </disk>
Aug 15 02:02:30 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:30 user nova-compute[73121]: WARNING nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-6f68bad0-3cde-4382-b499-61d134c3fbce for instance with vm_state building and task_state spawning.
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:30 user nova-compute[73121]: WARNING nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-6f68bad0-3cde-4382-b499-61d134c3fbce for instance with vm_state building and task_state spawning.
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:30 user nova-compute[73121]: WARNING nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 for instance with vm_state building and task_state spawning.
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:30 user nova-compute[73121]: WARNING nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 for instance with vm_state building and task_state spawning.
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:30 user nova-compute[73121]: WARNING nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-1785fd4a-8241-4c47-9f08-925c7fc16480 for instance with vm_state building and task_state spawning.
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:30 user nova-compute[73121]: WARNING nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-1785fd4a-8241-4c47-9f08-925c7fc16480 for instance with vm_state building and task_state spawning.
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:30 user nova-compute[73121]: WARNING nova.compute.manager [req-5acfa864-327a-43bd-a18a-c16a4e09efd9 req-27af3422-1c4a-429d-b715-c30053e5a1a4 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 for instance with vm_state building and task_state spawning.
Aug 15 02:02:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No VIF found with MAC fa:16:3e:a5:cc:77, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064950.9704015, 3626675d-6ed7-400c-998f-67501a107da3 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:02:30 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 3626675d-6ed7-400c-998f-67501a107da3] VM Resumed (Lifecycle Event)
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:02:30 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance spawned successfully.
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:02:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a5aa841f-5568-4993-ab03-cbe9fede4535 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.983s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:31 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 3626675d-6ed7-400c-998f-67501a107da3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064950.9732482, 3626675d-6ed7-400c-998f-67501a107da3 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:02:31 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 3626675d-6ed7-400c-998f-67501a107da3] VM Started (Lifecycle Event)
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:02:31 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 3626675d-6ed7-400c-998f-67501a107da3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:02:31 user nova-compute[73121]: INFO nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Took 16.75 seconds to spawn the instance on the hypervisor.
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:31 user nova-compute[73121]: INFO nova.compute.manager [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Took 48.02 seconds to build instance.
Aug 15 02:02:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3d377d4-6769-4793-9d2f-86715335e659 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "3626675d-6ed7-400c-998f-67501a107da3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.120s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-0267e622-b85b-49f8-94a5-27e487f4e1e6 req-18fbecd8-5e3f-4c14-a704-eee667a82ec3 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0267e622-b85b-49f8-94a5-27e487f4e1e6 req-18fbecd8-5e3f-4c14-a704-eee667a82ec3 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0267e622-b85b-49f8-94a5-27e487f4e1e6 req-18fbecd8-5e3f-4c14-a704-eee667a82ec3 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0267e622-b85b-49f8-94a5-27e487f4e1e6 req-18fbecd8-5e3f-4c14-a704-eee667a82ec3 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-0267e622-b85b-49f8-94a5-27e487f4e1e6 req-18fbecd8-5e3f-4c14-a704-eee667a82ec3 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:31 user nova-compute[73121]: WARNING nova.compute.manager [req-0267e622-b85b-49f8-94a5-27e487f4e1e6 req-18fbecd8-5e3f-4c14-a704-eee667a82ec3 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 for instance with vm_state building and task_state spawning.
Aug 15 02:02:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064952.3044915, b14c5889-916d-43cf-8faa-4373a5703c84 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:02:32 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] VM Resumed (Lifecycle Event)
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:32 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance spawned successfully.
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:02:32 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692064952.316828, b14c5889-916d-43cf-8faa-4373a5703c84 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:02:32 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] VM Started (Lifecycle Event)
Aug 15 02:02:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-129b70ed-1a92-4141-85d4-dc1860d63c00 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-129b70ed-1a92-4141-85d4-dc1860d63c00 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-129b70ed-1a92-4141-85d4-dc1860d63c00 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-129b70ed-1a92-4141-85d4-dc1860d63c00 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73121) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.objects.instance [None req-129b70ed-1a92-4141-85d4-dc1860d63c00 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:02:32 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:02:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:32 user nova-compute[73121]: INFO nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Took 17.30 seconds to spawn the instance on the hypervisor.
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-8297975f-115f-4691-8023-337c99b91296 req-adc1dd0a-3647-4fc3-b592-2b3b4de911da service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8297975f-115f-4691-8023-337c99b91296 req-adc1dd0a-3647-4fc3-b592-2b3b4de911da service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8297975f-115f-4691-8023-337c99b91296 req-adc1dd0a-3647-4fc3-b592-2b3b4de911da service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8297975f-115f-4691-8023-337c99b91296 req-adc1dd0a-3647-4fc3-b592-2b3b4de911da service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-8297975f-115f-4691-8023-337c99b91296 req-adc1dd0a-3647-4fc3-b592-2b3b4de911da service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:32 user nova-compute[73121]: WARNING nova.compute.manager [req-8297975f-115f-4691-8023-337c99b91296 req-adc1dd0a-3647-4fc3-b592-2b3b4de911da service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 for instance with vm_state building and task_state spawning.
Aug 15 02:02:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:32 user nova-compute[73121]: INFO nova.compute.manager [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Took 48.48 seconds to build instance.
Aug 15 02:02:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-add13cf1-c370-4b63-9fe7-10c313968070 tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "b14c5889-916d-43cf-8faa-4373a5703c84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.602s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:33 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance destroyed successfully.
Aug 15 02:02:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-129b70ed-1a92-4141-85d4-dc1860d63c00 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-129b70ed-1a92-4141-85d4-dc1860d63c00 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.111s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:33 user nova-compute[73121]: WARNING nova.compute.manager [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state None.
Aug 15 02:02:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:33 user nova-compute[73121]: WARNING nova.compute.manager [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state None.
Aug 15 02:02:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:33 user nova-compute[73121]: WARNING nova.compute.manager [req-1787af14-cf2f-4398-8cdc-2acdc9df6229 req-70de4ae8-ee6c-45da-940b-11b07e34e320 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state None.
Aug 15 02:02:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:35 user nova-compute[73121]: DEBUG nova.compute.manager [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:35 user nova-compute[73121]: DEBUG nova.compute.manager [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:35 user nova-compute[73121]: WARNING nova.compute.manager [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state None.
Aug 15 02:02:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:36 user nova-compute[73121]: WARNING nova.compute.manager [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state None.
Aug 15 02:02:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:36 user nova-compute[73121]: WARNING nova.compute.manager [req-bcf78eb8-12b7-4a72-aec7-9f902609b193 req-b6f0e339-925f-4bbe-aa46-5ef9d33a0b2a service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state None.
Aug 15 02:02:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIVLsiOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:39 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:39 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:39 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[56990207-95eb-4432-a5b1-67cc403f12af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:39 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f2a0f6-443b-4afe-8552-364699584a40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5] added
Aug 15 02:02:39 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f0e27-e1f3-4b54-8b75-213cd70e6550]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51fd1b7-8641-4e26-8e81-bad75d536bd3]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIVLsiOy {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kIVLsiOy" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[019c2963-3277-4482-bd7b-c556eac5b66a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kIVLsiOy'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7235865-4b01-4a7e-9872-68c2c733be60]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee0964c-278a-45a4-839b-ce942cfed557]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:39 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:39 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6568a06-3423-4bed-a3db-f9ca20137e30]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5, portal: 172.16.0.220,3260]
Aug 15 02:02:39 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:39 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[011e1abf-6973-495d-800a-f5620cee6f25]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[65df2bb2-3765-4208-aa31-ca00c84fc4e3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:39 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:39 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:39 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b775eadc-1431-4c27-bf25-9a2a2544ccd5]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIVLsiOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-e417d83c-e06c-4fae-babd-398754321573 req-028ad910-afb7-424c-9895-e2a38f2545b8 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received event network-changed-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-e417d83c-e06c-4fae-babd-398754321573 req-028ad910-afb7-424c-9895-e2a38f2545b8 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Refreshing instance network info cache due to event network-changed-896e7b3e-1b88-4a65-bdc2-06a5045a43f6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:02:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e417d83c-e06c-4fae-babd-398754321573 req-028ad910-afb7-424c-9895-e2a38f2545b8 service nova] Acquiring lock "refresh_cache-d7d7ea92-e89a-43cb-8e41-b983fa788244" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e417d83c-e06c-4fae-babd-398754321573 req-028ad910-afb7-424c-9895-e2a38f2545b8 service nova] Acquired lock "refresh_cache-d7d7ea92-e89a-43cb-8e41-b983fa788244" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:40 user nova-compute[73121]: DEBUG nova.network.neutron [req-e417d83c-e06c-4fae-babd-398754321573 req-028ad910-afb7-424c-9895-e2a38f2545b8 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Refreshing network info cache for port 896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '23634663831343236', 'path': '/dev/sdj'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634663831343236', 'path': '/dev/sdj'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lazy-loading 'flavor' on Instance uuid 78cda252-7cca-412c-ac97-24fc375d32de {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:02:41 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:02:41 user nova-compute[73121]:   <source dev="/dev/sdj"/>
Aug 15 02:02:41 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:02:41 user nova-compute[73121]:   <serial>937c51d2-f741-4657-89f8-987fad6700a5</serial>
Aug 15 02:02:41 user nova-compute[73121]: </disk>
Aug 15 02:02:41 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] No VIF found with MAC fa:16:3e:3f:7f:c5, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG nova.network.neutron [req-e417d83c-e06c-4fae-babd-398754321573 req-028ad910-afb7-424c-9895-e2a38f2545b8 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Updated VIF entry in instance network info cache for port 896e7b3e-1b88-4a65-bdc2-06a5045a43f6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG nova.network.neutron [req-e417d83c-e06c-4fae-babd-398754321573 req-028ad910-afb7-424c-9895-e2a38f2545b8 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Updating instance_info_cache with network_info: [{"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e417d83c-e06c-4fae-babd-398754321573 req-028ad910-afb7-424c-9895-e2a38f2545b8 service nova] Releasing lock "refresh_cache-d7d7ea92-e89a-43cb-8e41-b983fa788244" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "interface-793cddda-b586-4601-9f22-47938c9ccfb4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "interface-793cddda-b586-4601-9f22-47938c9ccfb4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lazy-loading 'flavor' on Instance uuid 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a7c54f02-a3b7-4d6f-9419-e221e3bc28f7 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.545s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "78cda252-7cca-412c-ac97-24fc375d32de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "78cda252-7cca-412c-ac97-24fc375d32de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:42 user nova-compute[73121]: INFO nova.compute.manager [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Terminating instance
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lazy-loading 'pci_requests' on Instance uuid 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.policy [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7967084f3b954a739fef6956a789cbad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '728a7726790042c99e4bd53c2967ee96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-changed-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Refreshing instance network info cache due to event network-changed-1c8be17e-3242-49dd-b0b0-cd0834cf845c. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] Acquiring lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] Acquired lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.network.neutron [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Refreshing network info cache for port 1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:02:42 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Instance destroyed successfully.
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lazy-loading 'resources' on Instance uuid 78cda252-7cca-412c-ac97-24fc375d32de {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-40316936',display_name='tempest-DeleteServersTestJSON-server-40316936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-40316936',id=4,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='df1cae4eab914ce5abe90d931e112c5c',ramdisk_id='',reservation_id='r-tptspjlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-679744656',owner_user_name='tempest-DeleteServersTestJSON-679744656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:00:41Z,user_data=None,user_id='47877ca691894793a44512cecf6218e5',uuid=78cda252-7cca-412c-ac97-24fc375d32de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Converting VIF {"id": "d840486f-df2b-40b1-a01e-14471d669645", "address": "fa:16:3e:3f:7f:c5", "network": {"id": "6b564e69-edd3-4efd-8f15-a8ad7f029860", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-30168337-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "df1cae4eab914ce5abe90d931e112c5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd840486f-df", "ovs_interfaceid": "d840486f-df2b-40b1-a01e-14471d669645", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:7f:c5,bridge_name='br-int',has_traffic_filtering=True,id=d840486f-df2b-40b1-a01e-14471d669645,network=Network(6b564e69-edd3-4efd-8f15-a8ad7f029860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd840486f-df') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG os_vif [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:7f:c5,bridge_name='br-int',has_traffic_filtering=True,id=d840486f-df2b-40b1-a01e-14471d669645,network=Network(6b564e69-edd3-4efd-8f15-a8ad7f029860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd840486f-df') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd840486f-df, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:42 user nova-compute[73121]: INFO os_vif [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:7f:c5,bridge_name='br-int',has_traffic_filtering=True,id=d840486f-df2b-40b1-a01e-14471d669645,network=Network(6b564e69-edd3-4efd-8f15-a8ad7f029860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd840486f-df')
Aug 15 02:02:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kIVLsiOy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:42 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:02:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9d1e56-d72d-4117-9d19-7b08cb94e078]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[323159ec-9ce7-4f07-9158-2c12afa47ea0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:43 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e205d6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5'): ({'sdj'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Removing single pathed devices sdj {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2007c2-be1b-43a9-be9a-060fb1ca34bb]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9460db0-ea9d-4157-ad09-fe939b135a79]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Flushing IO for device /dev/sdj {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb332c26-fbcc-44fb-ae9a-84c468cf11b4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.039s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d265d472-e175-4a84-a1ce-76ca6a1b9293]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] SCSI volumes sdj have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[838ac09c-3de8-4e83-a08d-1610056498b7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a7b5a-febc-4758-aec3-420f5c93b607]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5, portal: 172.16.0.220,3260]
Aug 15 02:02:43 user nova-compute[73121]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:937c51d2-f741-4657-89f8-987fad6700a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4031d087-946b-47a7-98ba-dd5046c37cd4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] <== disconnect_volume: return (367ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:02:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Deleting instance files /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de_del
Aug 15 02:02:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Deletion of /opt/stack/data/nova/instances/78cda252-7cca-412c-ac97-24fc375d32de_del complete
Aug 15 02:02:43 user nova-compute[73121]: INFO nova.compute.manager [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-653f006d-4dc3-4990-b64f-53ee5270eb8e req-c3e62e09-860d-48ad-827f-d206619bd7fc service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received event network-changed-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-653f006d-4dc3-4990-b64f-53ee5270eb8e req-c3e62e09-860d-48ad-827f-d206619bd7fc service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Refreshing instance network info cache due to event network-changed-699f8498-cccf-4a68-ba6c-366e8ee2a959. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-653f006d-4dc3-4990-b64f-53ee5270eb8e req-c3e62e09-860d-48ad-827f-d206619bd7fc service nova] Acquiring lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-653f006d-4dc3-4990-b64f-53ee5270eb8e req-c3e62e09-860d-48ad-827f-d206619bd7fc service nova] Acquired lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-653f006d-4dc3-4990-b64f-53ee5270eb8e req-c3e62e09-860d-48ad-827f-d206619bd7fc service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Refreshing network info cache for port 699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updated VIF entry in instance network info cache for port 1c8be17e-3242-49dd-b0b0-cd0834cf845c. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updating instance_info_cache with network_info: [{"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] Releasing lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received event network-vif-unplugged-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] Acquiring lock "78cda252-7cca-412c-ac97-24fc375d32de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] No waiting events found dispatching network-vif-unplugged-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-517e447e-c1d3-41d2-b219-c11ca48dc06d req-7b491c42-18b2-45ef-ba0e-16048da4c1bb service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received event network-vif-unplugged-d840486f-df2b-40b1-a01e-14471d669645 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:02:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Successfully created port: 4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-653f006d-4dc3-4990-b64f-53ee5270eb8e req-c3e62e09-860d-48ad-827f-d206619bd7fc service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Updated VIF entry in instance network info cache for port 699f8498-cccf-4a68-ba6c-366e8ee2a959. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-653f006d-4dc3-4990-b64f-53ee5270eb8e req-c3e62e09-860d-48ad-827f-d206619bd7fc service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Updating instance_info_cache with network_info: [{"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-653f006d-4dc3-4990-b64f-53ee5270eb8e req-c3e62e09-860d-48ad-827f-d206619bd7fc service nova] Releasing lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:44 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Took 0.71 seconds to deallocate network for instance.
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-5beb6459-9bcd-4c97-bffe-fc32629e252c req-1c8d85b7-d497-4dbe-964f-cb769c53588b service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received event network-vif-deleted-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:44 user nova-compute[73121]: INFO nova.compute.manager [req-5beb6459-9bcd-4c97-bffe-fc32629e252c req-1c8d85b7-d497-4dbe-964f-cb769c53588b service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Neutron deleted interface d840486f-df2b-40b1-a01e-14471d669645; detaching it from the instance and deleting it from the info cache
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-5beb6459-9bcd-4c97-bffe-fc32629e252c req-1c8d85b7-d497-4dbe-964f-cb769c53588b service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-5beb6459-9bcd-4c97-bffe-fc32629e252c req-1c8d85b7-d497-4dbe-964f-cb769c53588b service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Detach interface failed, port_id=d840486f-df2b-40b1-a01e-14471d669645, reason: Instance 78cda252-7cca-412c-ac97-24fc375d32de could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Successfully updated port: 4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquired lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-2a67e163-274f-4d26-91eb-6cb4ceeff74f req-82e23127-7b3c-42cd-82af-3a219d69185e service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received event network-vif-plugged-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2a67e163-274f-4d26-91eb-6cb4ceeff74f req-82e23127-7b3c-42cd-82af-3a219d69185e service nova] Acquiring lock "78cda252-7cca-412c-ac97-24fc375d32de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2a67e163-274f-4d26-91eb-6cb4ceeff74f req-82e23127-7b3c-42cd-82af-3a219d69185e service nova] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2a67e163-274f-4d26-91eb-6cb4ceeff74f req-82e23127-7b3c-42cd-82af-3a219d69185e service nova] Lock "78cda252-7cca-412c-ac97-24fc375d32de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-2a67e163-274f-4d26-91eb-6cb4ceeff74f req-82e23127-7b3c-42cd-82af-3a219d69185e service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] No waiting events found dispatching network-vif-plugged-d840486f-df2b-40b1-a01e-14471d669645 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:44 user nova-compute[73121]: WARNING nova.compute.manager [req-2a67e163-274f-4d26-91eb-6cb4ceeff74f req-82e23127-7b3c-42cd-82af-3a219d69185e service nova] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Received unexpected event network-vif-plugged-d840486f-df2b-40b1-a01e-14471d669645 for instance with vm_state active and task_state deleting.
Aug 15 02:02:45 user nova-compute[73121]: INFO nova.compute.manager [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Took 0.91 seconds to detach 1 volumes for instance.
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updating instance_info_cache with network_info: [{"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Releasing lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1318082023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1318082023',id=6,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaNdyYz27xk+rfspm0CM27aYjNNYrCrxWXHlEOIfv3Q6WatZXVBNwBJYMUI8ec6jJvv3xvpG28G35Inoo6iygE/loMQdezawYx8ddyYXrAFA1EYbDFxyVvB9BTw1fLZcA==',key_name='tempest-keypair-479875827',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='728a7726790042c99e4bd53c2967ee96',ramdisk_id='',reservation_id='r-16w40iyx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2030671207',owner_user_name='tempest-TaggedAttachmentsTest-2030671207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7967084f3b954a739fef6956a789cbad',uuid=793cddda-b586-4601-9f22-47938c9ccfb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converting VIF {"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b8:a1,bridge_name='br-int',has_traffic_filtering=True,id=4231262d-1a27-45f5-818a-f73f46523c16,network=Network(7b553a96-cbf9-475f-bf30-1edeacec3051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4231262d-1a') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG os_vif [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b8:a1,bridge_name='br-int',has_traffic_filtering=True,id=4231262d-1a27-45f5-818a-f73f46523c16,network=Network(7b553a96-cbf9-475f-bf30-1edeacec3051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4231262d-1a') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4231262d-1a, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4231262d-1a, col_values=(('external_ids', {'iface-id': '4231262d-1a27-45f5-818a-f73f46523c16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:b8:a1', 'vm-uuid': '793cddda-b586-4601-9f22-47938c9ccfb4'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:45 user nova-compute[73121]: INFO os_vif [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b8:a1,bridge_name='br-int',has_traffic_filtering=True,id=4231262d-1a27-45f5-818a-f73f46523c16,network=Network(7b553a96-cbf9-475f-bf30-1edeacec3051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4231262d-1a')
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1318082023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1318082023',id=6,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaNdyYz27xk+rfspm0CM27aYjNNYrCrxWXHlEOIfv3Q6WatZXVBNwBJYMUI8ec6jJvv3xvpG28G35Inoo6iygE/loMQdezawYx8ddyYXrAFA1EYbDFxyVvB9BTw1fLZcA==',key_name='tempest-keypair-479875827',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='728a7726790042c99e4bd53c2967ee96',ramdisk_id='',reservation_id='r-16w40iyx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2030671207',owner_user_name='tempest-TaggedAttachmentsTest-2030671207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7967084f3b954a739fef6956a789cbad',uuid=793cddda-b586-4601-9f22-47938c9ccfb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converting VIF {"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:b8:a1,bridge_name='br-int',has_traffic_filtering=True,id=4231262d-1a27-45f5-818a-f73f46523c16,network=Network(7b553a96-cbf9-475f-bf30-1edeacec3051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4231262d-1a') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] attach device xml: <interface type="ethernet">
Aug 15 02:02:45 user nova-compute[73121]:   <mac address="fa:16:3e:8b:b8:a1"/>
Aug 15 02:02:45 user nova-compute[73121]:   <model type="virtio"/>
Aug 15 02:02:45 user nova-compute[73121]:   <mtu size="1442"/>
Aug 15 02:02:45 user nova-compute[73121]:   <target dev="tap4231262d-1a"/>
Aug 15 02:02:45 user nova-compute[73121]: </interface>
Aug 15 02:02:45 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lazy-loading 'flavor' on Instance uuid d7d7ea92-e89a-43cb-8e41-b983fa788244 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.139s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.objects.instance [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lazy-loading 'flavor' on Instance uuid 66e5ded4-d25e-443f-b000-df3b693555dd {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.615s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:45 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Deleted allocations for instance 78cda252-7cca-412c-ac97-24fc375d32de
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.156s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:45 user nova-compute[73121]: INFO nova.compute.manager [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Attaching volume 325622b1-19b8-45aa-a0e2-68adb8b1262b to /dev/sdc
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a407fa0e-5035-43ef-9509-624ca4d72d03 tempest-DeleteServersTestJSON-679744656 tempest-DeleteServersTestJSON-679744656-project-member] Lock "78cda252-7cca-412c-ac97-24fc375d32de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.910s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-dcfbff23-570e-4734-90ae-85902035daa4 req-cd60bc3c-46f5-49c7-a4b3-e04c2ab59b03 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-changed-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-dcfbff23-570e-4734-90ae-85902035daa4 req-cd60bc3c-46f5-49c7-a4b3-e04c2ab59b03 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Refreshing instance network info cache due to event network-changed-4231262d-1a27-45f5-818a-f73f46523c16. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dcfbff23-570e-4734-90ae-85902035daa4 req-cd60bc3c-46f5-49c7-a4b3-e04c2ab59b03 service nova] Acquiring lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dcfbff23-570e-4734-90ae-85902035daa4 req-cd60bc3c-46f5-49c7-a4b3-e04c2ab59b03 service nova] Acquired lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:45 user nova-compute[73121]: DEBUG nova.network.neutron [req-dcfbff23-570e-4734-90ae-85902035daa4 req-cd60bc3c-46f5-49c7-a4b3-e04c2ab59b03 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Refreshing network info cache for port 4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] No BDM found with device name hda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] No VIF found with MAC fa:16:3e:a4:6b:67, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.utils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeae3e2-a686-45d0-ac36-2b3476139f7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:02:46 user nova-compute[73121]:   <nova:package version="0.0.0"/>
Aug 15 02:02:46 user nova-compute[73121]:   <nova:name>tempest-device-tagging-server-1318082023</nova:name>
Aug 15 02:02:46 user nova-compute[73121]:   <nova:creationTime>2023-08-15 02:02:46</nova:creationTime>
Aug 15 02:02:46 user nova-compute[73121]:   <nova:flavor name="m1.tiny">
Aug 15 02:02:46 user nova-compute[73121]:     <nova:memory>512</nova:memory>
Aug 15 02:02:46 user nova-compute[73121]:     <nova:disk>1</nova:disk>
Aug 15 02:02:46 user nova-compute[73121]:     <nova:swap>0</nova:swap>
Aug 15 02:02:46 user nova-compute[73121]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:02:46 user nova-compute[73121]:     <nova:vcpus>1</nova:vcpus>
Aug 15 02:02:46 user nova-compute[73121]:   </nova:flavor>
Aug 15 02:02:46 user nova-compute[73121]:   <nova:owner>
Aug 15 02:02:46 user nova-compute[73121]:     <nova:user uuid="7967084f3b954a739fef6956a789cbad">tempest-TaggedAttachmentsTest-2030671207-project-member</nova:user>
Aug 15 02:02:46 user nova-compute[73121]:     <nova:project uuid="728a7726790042c99e4bd53c2967ee96">tempest-TaggedAttachmentsTest-2030671207</nova:project>
Aug 15 02:02:46 user nova-compute[73121]:   </nova:owner>
Aug 15 02:02:46 user nova-compute[73121]:   <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:02:46 user nova-compute[73121]:   <nova:ports>
Aug 15 02:02:46 user nova-compute[73121]:     <nova:port uuid="1c8be17e-3242-49dd-b0b0-cd0834cf845c">
Aug 15 02:02:46 user nova-compute[73121]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 02:02:46 user nova-compute[73121]:     </nova:port>
Aug 15 02:02:46 user nova-compute[73121]:     <nova:port uuid="4231262d-1a27-45f5-818a-f73f46523c16">
Aug 15 02:02:46 user nova-compute[73121]:       <nova:ip type="fixed" address="10.10.10.204" ipVersion="4"/>
Aug 15 02:02:46 user nova-compute[73121]:     </nova:port>
Aug 15 02:02:46 user nova-compute[73121]:   </nova:ports>
Aug 15 02:02:46 user nova-compute[73121]: </nova:instance>
Aug 15 02:02:46 user nova-compute[73121]:  {{(pid=73121) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[08853dcf-f968-4638-b860-6ab22830a6c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:46 user nova-compute[73121]: INFO nova.compute.manager [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Attaching volume decccaee-f0b8-4faf-86af-4a02652e2639 to /dev/vdb
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5841f79b-58d4-4479-a2da-0e7b36e3868d tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "interface-793cddda-b586-4601-9f22-47938c9ccfb4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.345s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc3383e-74c2-436f-aaf6-7e63b9c9a299]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[28125bae-042d-4864-be1a-4cfc6982e972]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:46 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf26ddf-dd46-4bb6-9520-0699d33fe483]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.utils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] <== get_connector_properties: return (191ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Updating existing volume attachment record: 62ec6f74-560a-473e-b4c7-e77249967495 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.utils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received event network-changed-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Refreshing instance network info cache due to event network-changed-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] Acquiring lock "refresh_cache-66e5ded4-d25e-443f-b000-df3b693555dd" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] Acquired lock "refresh_cache-66e5ded4-d25e-443f-b000-df3b693555dd" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Refreshing network info cache for port 64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6cfff7-ef9d-4d94-a5cb-4fa95ccba2fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a961abf-3f34-4751-9626-6e2e61e8ae15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[890f4683-8945-47e8-aecb-6776e4f0bac8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd33205-1bd8-4f8c-a3aa-d627e70b0ef6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:46 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:02:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a13626-ce37-477f-9787-5b9806de5959]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.utils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Updating existing volume attachment record: 6897ae0b-8585-4c13-b260-0430f0fbe2cc {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-dcfbff23-570e-4734-90ae-85902035daa4 req-cd60bc3c-46f5-49c7-a4b3-e04c2ab59b03 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updated VIF entry in instance network info cache for port 4231262d-1a27-45f5-818a-f73f46523c16. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-dcfbff23-570e-4734-90ae-85902035daa4 req-cd60bc3c-46f5-49c7-a4b3-e04c2ab59b03 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updating instance_info_cache with network_info: [{"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dcfbff23-570e-4734-90ae-85902035daa4 req-cd60bc3c-46f5-49c7-a4b3-e04c2ab59b03 service nova] Releasing lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG nova.objects.instance [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lazy-loading 'flavor' on Instance uuid 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:46 user nova-compute[73121]: INFO nova.compute.manager [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Attaching volume 422ba3f5-a5dd-4c69-af14-3f18cbb4029c to /dev/vdb
Aug 15 02:02:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG os_brick.utils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f094429-214e-48bd-be69-d7ade92a6e5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f18d9ef-89dc-4998-ba46-54ec22ef28d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eb654e-7c64-443f-8b0b-095b2fdfc08b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c13de95-20f4-4e38-84d8-59c311e1a4a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:47 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e7e074-c942-496c-857f-57bee0febed0]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG os_brick.utils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updating existing volume attachment record: b9b3ebc6-fd4f-4ceb-8ec4-9ea0d1dfa708 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Updated VIF entry in instance network info cache for port 64ea77e9-d4fe-49e3-adae-2a4a0284b0c1. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Updating instance_info_cache with network_info: [{"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] Releasing lock "refresh_cache-66e5ded4-d25e-443f-b000-df3b693555dd" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-plugged-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] No waiting events found dispatching network-vif-plugged-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:47 user nova-compute[73121]: WARNING nova.compute.manager [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received unexpected event network-vif-plugged-4231262d-1a27-45f5-818a-f73f46523c16 for instance with vm_state active and task_state None.
Aug 15 02:02:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-plugged-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] No waiting events found dispatching network-vif-plugged-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:02:47 user nova-compute[73121]: WARNING nova.compute.manager [req-354f76fd-d3da-4a2d-8df8-b65325196b7a req-88356dca-b109-48a0-b568-4e62d9b4c7f1 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received unexpected event network-vif-plugged-4231262d-1a27-45f5-818a-f73f46523c16 for instance with vm_state active and task_state None.
Aug 15 02:02:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-0f5e6ad0-579f-409a-a0ba-11556bf5025c req-842def12-faa4-4aaf-8c56-435346477b0b service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received event network-changed-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:02:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-0f5e6ad0-579f-409a-a0ba-11556bf5025c req-842def12-faa4-4aaf-8c56-435346477b0b service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Refreshing instance network info cache due to event network-changed-0dcc5fbd-cacb-44ff-8dd1-db427fa919af. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:02:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0f5e6ad0-579f-409a-a0ba-11556bf5025c req-842def12-faa4-4aaf-8c56-435346477b0b service nova] Acquiring lock "refresh_cache-03db2b8d-c678-4763-a87c-93e001ed9605" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:02:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0f5e6ad0-579f-409a-a0ba-11556bf5025c req-842def12-faa4-4aaf-8c56-435346477b0b service nova] Acquired lock "refresh_cache-03db2b8d-c678-4763-a87c-93e001ed9605" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:02:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-0f5e6ad0-579f-409a-a0ba-11556bf5025c req-842def12-faa4-4aaf-8c56-435346477b0b service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Refreshing network info cache for port 0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:02:48 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692064953.4428716, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:02:48 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] VM Stopped (Lifecycle Event)
Aug 15 02:02:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-636f811b-1cea-457d-b8b6-fabf8fcd4b40 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-636f811b-1cea-457d-b8b6-fabf8fcd4b40 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:02:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-0f5e6ad0-579f-409a-a0ba-11556bf5025c req-842def12-faa4-4aaf-8c56-435346477b0b service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Updated VIF entry in instance network info cache for port 0dcc5fbd-cacb-44ff-8dd1-db427fa919af. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:02:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-0f5e6ad0-579f-409a-a0ba-11556bf5025c req-842def12-faa4-4aaf-8c56-435346477b0b service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Updating instance_info_cache with network_info: [{"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:02:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0f5e6ad0-579f-409a-a0ba-11556bf5025c req-842def12-faa4-4aaf-8c56-435346477b0b service nova] Releasing lock "refresh_cache-03db2b8d-c678-4763-a87c-93e001ed9605" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:02:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTIofSmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:57 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:57 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:57 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ea2ca2-81f1-4296-9d76-11cc09c6be5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:57 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fae716-51ad-4b3e-bbb4-f400b87fb41c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b] added
Aug 15 02:02:57 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbe53e8-ee3d-43c6-9787-20c73f51f1db]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4c9fe6-ed5e-4836-bae0-ca254f20f93c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTIofSmp {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTIofSmp" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fd6e27-d450-4de7-8597-8d24e03cdeb8]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PTIofSmp'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[add68782-6420-45ff-915c-9c2137f752a2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29f0099-194c-4809-9ec6-02a0035175fa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:57 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:57 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lazy-loading 'flavor' on Instance uuid 03db2b8d-c678-4763-a87c-93e001ed9605 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOgnjWqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:57 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[15367785-f14f-4449-af80-b1e67a5a0d6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b, portal: 172.16.0.220,3260]
Aug 15 02:02:57 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:57 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lazy-loading 'flavor' on Instance uuid 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c8832b-3b77-4abb-b84d-af0e1ffd7b89]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[95954c48-79c6-43d8-b8a0-dc5283e68317]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:57 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:57 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:57 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d5cbbf-a339-4722-aed3-ee65dfc064e2]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTIofSmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:57 user nova-compute[73121]: INFO nova.compute.manager [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Attaching volume a9df1930-3ce3-443f-9b6d-e1128179b5cd to /dev/vdb
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:02:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Attaching volume a535e004-46f7-4d67-aa64-09e4c9a05700 to /dev/vdb
Aug 15 02:02:57 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692064962.9262848, 78cda252-7cca-412c-ac97-24fc375d32de => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:02:57 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] VM Stopped (Lifecycle Event)
Aug 15 02:02:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d99279ea-d5e1-4a1f-9f47-d7b8aa0f4499 None None] [instance: 78cda252-7cca-412c-ac97-24fc375d32de] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.utils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG os_brick.utils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5da732-4572-4dbd-a3c4-953dd7e1dafa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[340fd430-7ea8-4f3b-9405-8955d3fc7795]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a05f450-7074-4a2a-915d-876f82fa577f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4c0672-14f5-4053-8946-4929dc80b245]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[40820860-a24d-4537-ae78-4883ceb07b4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cab5aae-d35e-4474-b6b6-8243473bf0ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08c4cdd-370c-4fcd-b33f-7ceef0219a95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a67da-49e3-47df-bdf7-c6aaec83b12d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvdlMPqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:02:58 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:58 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ff53c7-576d-414b-856d-0269402e4629]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:02:58 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc2b46-c393-4aac-b527-74c7bc0187cc]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.utils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Updating existing volume attachment record: 01cfd6e9-6e74-4825-b5e4-1a7d1a7baded {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.utils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Updating existing volume attachment record: 4a0904d6-e156-4b9c-b44f-bd3e77692070 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26666623237353364', 'path': '/dev/sdj'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666623237353364', 'path': '/dev/sdj'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.155s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:58 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:02:58 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lazy-loading 'flavor' on Instance uuid d7d7ea92-e89a-43cb-8e41-b983fa788244 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2987213f-4392-4218-99c1-022520815f3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:02:58 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:02:58 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:02:58 user nova-compute[73121]:   <source dev="/dev/sdj"/>
Aug 15 02:02:58 user nova-compute[73121]:   <target dev="sdc" bus="scsi"/>
Aug 15 02:02:58 user nova-compute[73121]:   <serial>325622b1-19b8-45aa-a0e2-68adb8b1262b</serial>
Aug 15 02:02:58 user nova-compute[73121]:   <address type="drive" controller="0" unit="2"/>
Aug 15 02:02:58 user nova-compute[73121]: </disk>
Aug 15 02:02:58 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c3eac1-cf9f-4cb9-be39-484aed0ff504]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639] added
Aug 15 02:02:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b2f3d8-8963-4770-8934-ecbe2aed0e12]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed06f94-1be9-4919-ab41-3c568b5102e6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOgnjWqT {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YOgnjWqT" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c01c6cd-2729-4e29-b80b-c866468e600a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YOgnjWqT'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d3d232-d860-4285-ae36-8cf0fdecc4ec]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b4ebdc-9ecc-44f9-8d32-e0c7ea43434b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:58 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[694cc634-095d-4f66-b6c2-ff923b9d80c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639, portal: 172.16.0.220,3260]
Aug 15 02:02:59 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639, portal: 172.16.0.220,3260] successful.
Aug 15 02:02:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca342a16-e80c-4ccb-92b0-351caa613419]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[761891b5-0239-4f4a-9b1f-fdde571a1058]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:02:59 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:02:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] HCTL ('42', '-', '-', 0) found on session 12 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Scanning host 42 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b3d802-acfe-419c-9c2d-912950a3017f]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Searching for a device in session 12 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOgnjWqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] No BDM found with device name sda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] No VIF found with MAC fa:16:3e:97:33:47, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:02:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d91bf7dd-d1f9-47de-9bb3-a5477fc88ffa tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.498s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] <== connect_volume: return (2562ms) {'type': 'block', 'scsi_wwn': '23762613265663133', 'path': '/dev/sdk'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762613265663133', 'path': '/dev/sdk'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.070s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:00 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:00 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.objects.instance [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lazy-loading 'flavor' on Instance uuid 66e5ded4-d25e-443f-b000-df3b693555dd {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b74c7c-3415-4275-a656-d5fa627709da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:03:00 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: INFO nova.compute.manager [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Detaching volume 325622b1-19b8-45aa-a0e2-68adb8b1262b
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a632eef1-73e7-4110-ba28-4db1598e3d61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c] added
Aug 15 02:03:00 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] attach device xml: <disk type="block" device="disk">
Aug 15 02:03:00 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:00 user nova-compute[73121]:   <source dev="/dev/sdk"/>
Aug 15 02:03:00 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:00 user nova-compute[73121]:   <serial>decccaee-f0b8-4faf-86af-4a02652e2639</serial>
Aug 15 02:03:00 user nova-compute[73121]: </disk>
Aug 15 02:03:00 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6128ebe1-68e3-4d9b-9724-b9ab9b77d6b6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0792f226-0ade-458d-b85c-4627f2e73d31]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvdlMPqo {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: INFO nova.virt.block_device [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Attempting to driver detach volume 325622b1-19b8-45aa-a0e2-68adb8b1262b from mountpoint /dev/sdc
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Attempting to detach device sdc from instance d7d7ea92-e89a-43cb-8e41-b983fa788244 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:00 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:00 user nova-compute[73121]:   <source dev="/dev/sdj"/>
Aug 15 02:03:00 user nova-compute[73121]:   <target dev="sdc" bus="scsi"/>
Aug 15 02:03:00 user nova-compute[73121]:   <serial>325622b1-19b8-45aa-a0e2-68adb8b1262b</serial>
Aug 15 02:03:00 user nova-compute[73121]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 02:03:00 user nova-compute[73121]: </disk>
Aug 15 02:03:00 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvdlMPqo" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3df6cf0-567d-4a38-a263-f501dac26228]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XvdlMPqo'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Successfully detached device sdc from instance d7d7ea92-e89a-43cb-8e41-b983fa788244 from the persistent domain config.
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d7d7ea92-e89a-43cb-8e41-b983fa788244 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:00 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:00 user nova-compute[73121]:   <source dev="/dev/sdj"/>
Aug 15 02:03:00 user nova-compute[73121]:   <target dev="sdc" bus="scsi"/>
Aug 15 02:03:00 user nova-compute[73121]:   <serial>325622b1-19b8-45aa-a0e2-68adb8b1262b</serial>
Aug 15 02:03:00 user nova-compute[73121]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 02:03:00 user nova-compute[73121]: </disk>
Aug 15 02:03:00 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e02989-ea4d-4cff-9a7c-408ca27e9e1e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[366b1af6-eb88-43fe-b79d-ed48d5161660]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:00 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:00 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9c58c6-a846-43c0-8b8e-2d18f5bda8c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c, portal: 172.16.0.220,3260]
Aug 15 02:03:00 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:00 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9e6147-fbbc-4cf0-b0a1-9ba18d103691]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d722804-69fe-4c3e-b735-4635dfad99a7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:00 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:00 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:00 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] HCTL ('43', '-', '-', 0) found on session 13 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[10331897-eefe-4193-b858-8515772bf088]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Searching for a device in session 13 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Connected to sdl using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvdlMPqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] No VIF found with MAC fa:16:3e:09:04:81, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-31444d9b-95b8-45c7-9e19-24e4df8b7e92 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.710s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692064980.9298959, d7d7ea92-e89a-43cb-8e41-b983fa788244 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d7d7ea92-e89a-43cb-8e41-b983fa788244 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:03:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Successfully detached device sdc from instance d7d7ea92-e89a-43cb-8e41-b983fa788244 from the live domain config.
Aug 15 02:03:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTIofSmp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:00 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] <== connect_volume: return (3486ms) {'type': 'block', 'scsi_wwn': '23764303331643039', 'path': '/dev/sdl'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764303331643039', 'path': '/dev/sdl'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.657s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG nova.objects.instance [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lazy-loading 'flavor' on Instance uuid 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b781ca4-7bcd-435c-b410-24a8628b8d31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:03:01 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:01 user nova-compute[73121]:   <source dev="/dev/sdl"/>
Aug 15 02:03:01 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:01 user nova-compute[73121]:   <serial>422ba3f5-a5dd-4c69-af14-3f18cbb4029c</serial>
Aug 15 02:03:01 user nova-compute[73121]: </disk>
Aug 15 02:03:01 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[db81626e-c577-46da-a409-db5f5b91ad32]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:01 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:01 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:01 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e34bbb7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b'): ({'sdj'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Removing single pathed devices sdj {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4b5a9c-aaf5-40dc-9d89-858de7a1a1c5]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fa9001-55a5-45b6-9599-3465a28ef424]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Flushing IO for device /dev/sdj {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef8e86a-b9be-4046-9258-b214eba2db29]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.052s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eba3f71-c1d2-4197-b24d-7225b216a010]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] SCSI volumes sdj have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d8dfd2e5-48be-40c9-808e-c4483a787301 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] volume_snapshot_create: create_info: {'snapshot_id': 'f3102e59-2b69-43e7-8f3e-8991648947e8', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73121) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d8dfd2e5-48be-40c9-808e-c4483a787301 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] snap xml: <domainsnapshot>
Aug 15 02:03:01 user nova-compute[73121]:   <disks>
Aug 15 02:03:01 user nova-compute[73121]:     <disk name="/dev/sdk" snapshot="external" type="file">
Aug 15 02:03:01 user nova-compute[73121]:       <source file="/dev/new_file"/>
Aug 15 02:03:01 user nova-compute[73121]:     </disk>
Aug 15 02:03:01 user nova-compute[73121]:     <disk name="vda" snapshot="no"/>
Aug 15 02:03:01 user nova-compute[73121]:   </disks>
Aug 15 02:03:01 user nova-compute[73121]: </domainsnapshot>
Aug 15 02:03:01 user nova-compute[73121]:  {{(pid=73121) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d8dfd2e5-48be-40c9-808e-c4483a787301 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lazy-loading 'system_metadata' on Instance uuid 66e5ded4-d25e-443f-b000-df3b693555dd {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10fdd56-509c-441f-bfe8-ab5c60d4c71a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:01 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d8dfd2e5-48be-40c9-808e-c4483a787301 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [None req-d8dfd2e5-48be-40c9-808e-c4483a787301 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Traceback (most recent call last):
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     rv = execute(f, *args, **kwargs)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     six.reraise(c, e, tb)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     raise value
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     rv = meth(*args, **kwargs)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] 
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [None req-d8dfd2e5-48be-40c9-808e-c4483a787301 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Traceback (most recent call last):
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     self._volume_snapshot_create(context, instance, guest,
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     rv = execute(f, *args, **kwargs)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     six.reraise(c, e, tb)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     raise value
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     rv = meth(*args, **kwargs)
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] 
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[22884a90-5774-4406-be86-9e360f526ef6]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ae9f1259-d6ba-4932-ba32-f75a64fcf017 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] volume_snapshot_delete: delete_info: {'volume_id': 'decccaee-f0b8-4faf-86af-4a02652e2639'} {{(pid=73121) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [None req-ae9f1259-d6ba-4932-ba32-f75a64fcf017 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Traceback (most recent call last):
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd]     if delete_info['type'] != 'qcow2':
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] KeyError: 'type'
Aug 15 02:03:01 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] 
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b, portal: 172.16.0.220,3260]
Aug 15 02:03:01 user nova-compute[73121]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:01 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:325622b1-19b8-45aa-a0e2-68adb8b1262b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb90fb6-685b-4217-b13a-abfdf031f40d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] <== disconnect_volume: return (1029ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [None req-d8dfd2e5-48be-40c9-808e-c4483a787301 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot f3102e59-2b69-43e7-8f3e-8991648947e8 could not be found.
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     raise value
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot f3102e59-2b69-43e7-8f3e-8991648947e8 could not be found. (HTTP 404) (Request-ID: req-e48423d6-6db6-43a0-8921-54f2d6652ecf)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot f3102e59-2b69-43e7-8f3e-8991648947e8 could not be found.
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server [None req-d8dfd2e5-48be-40c9-808e-c4483a787301 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     raise value
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server 
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver [None req-ae9f1259-d6ba-4932-ba32-f75a64fcf017 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-8e32daa4-50eb-41c1-a4f0-16d2b13a232a)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 02:03:02 user nova-compute[73121]: ERROR nova.virt.libvirt.driver 
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server [None req-ae9f1259-d6ba-4932-ba32-f75a64fcf017 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Exception during message handling: KeyError: 'type'
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 15 02:03:02 user nova-compute[73121]: ERROR oslo_messaging.rpc.server 
Aug 15 02:03:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] No BDM found with device name hda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] No VIF found with MAC fa:16:3e:a4:6b:67, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:03:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lazy-loading 'flavor' on Instance uuid d7d7ea92-e89a-43cb-8e41-b983fa788244 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a7cc3762-2629-45de-a799-6e370e56994f tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.673s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8c5b41a5-41ae-440f-a552-15c532a38434 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.136s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:03 user nova-compute[73121]: INFO nova.compute.manager [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Detaching volume decccaee-f0b8-4faf-86af-4a02652e2639
Aug 15 02:03:03 user nova-compute[73121]: INFO nova.virt.block_device [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Attempting to driver detach volume decccaee-f0b8-4faf-86af-4a02652e2639 from mountpoint /dev/vdb
Aug 15 02:03:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Attempting to detach device vdb from instance 66e5ded4-d25e-443f-b000-df3b693555dd from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:03 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:03 user nova-compute[73121]:   <source dev="/dev/sdk"/>
Aug 15 02:03:03 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:03 user nova-compute[73121]:   <serial>decccaee-f0b8-4faf-86af-4a02652e2639</serial>
Aug 15 02:03:03 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:03:03 user nova-compute[73121]: </disk>
Aug 15 02:03:03 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Successfully detached device vdb from instance 66e5ded4-d25e-443f-b000-df3b693555dd from the persistent domain config.
Aug 15 02:03:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 66e5ded4-d25e-443f-b000-df3b693555dd from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:03 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:03 user nova-compute[73121]:   <source dev="/dev/sdk"/>
Aug 15 02:03:03 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:03 user nova-compute[73121]:   <serial>decccaee-f0b8-4faf-86af-4a02652e2639</serial>
Aug 15 02:03:03 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:03:03 user nova-compute[73121]: </disk>
Aug 15 02:03:03 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:03 user nova-compute[73121]: INFO nova.compute.manager [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Terminating instance
Aug 15 02:03:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692064983.8572388, 66e5ded4-d25e-443f-b000-df3b693555dd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 66e5ded4-d25e-443f-b000-df3b693555dd {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:03:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Successfully detached device vdb from instance 66e5ded4-d25e-443f-b000-df3b693555dd from the live domain config.
Aug 15 02:03:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YOgnjWqT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:03 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[631d98e2-26e7-40b8-a14f-7304ff4fac5e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb71afcc-640d-41df-ba2d-ca01bb5c9306]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:03 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:03 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:03 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc7885e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639'): ({'sdk'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Removing single pathed devices sdk {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99c1d82-abe0-4e19-9607-a5ba17c60b10]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad843dc9-5383-40ab-a9e5-48e9a2fed0fe]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Flushing IO for device /dev/sdk {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-30bd7bef-cee7-495d-b0f4-078e222eb7b2 req-45bea9a1-6a6c-4ad8-9713-59b57fff7889 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received event network-vif-unplugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-30bd7bef-cee7-495d-b0f4-078e222eb7b2 req-45bea9a1-6a6c-4ad8-9713-59b57fff7889 service nova] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-30bd7bef-cee7-495d-b0f4-078e222eb7b2 req-45bea9a1-6a6c-4ad8-9713-59b57fff7889 service nova] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-30bd7bef-cee7-495d-b0f4-078e222eb7b2 req-45bea9a1-6a6c-4ad8-9713-59b57fff7889 service nova] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-30bd7bef-cee7-495d-b0f4-078e222eb7b2 req-45bea9a1-6a6c-4ad8-9713-59b57fff7889 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] No waiting events found dispatching network-vif-unplugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-30bd7bef-cee7-495d-b0f4-078e222eb7b2 req-45bea9a1-6a6c-4ad8-9713-59b57fff7889 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received event network-vif-unplugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c23989-d6e5-490d-8a2e-0c244444197a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.050s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32d9050-248f-4e47-bf4b-ee9c208abad2]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] SCSI volumes sdk have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:04 user nova-compute[73121]: INFO nova.compute.manager [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Detaching volume 422ba3f5-a5dd-4c69-af14-3f18cbb4029c
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[474f11df-43e0-4410-ab5c-70051002c0d8]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a618a-b477-442b-95fe-f1a6603aff5f]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639, portal: 172.16.0.220,3260]
Aug 15 02:03:04 user nova-compute[73121]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:04 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:decccaee-f0b8-4faf-86af-4a02652e2639 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcfa6ee-3179-4be0-a047-0a52fa190b06]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] <== disconnect_volume: return (387ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:04 user nova-compute[73121]: INFO nova.virt.block_device [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Attempting to driver detach volume 422ba3f5-a5dd-4c69-af14-3f18cbb4029c from mountpoint /dev/vdb
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Attempting to detach device vdb from instance 793cddda-b586-4601-9f22-47938c9ccfb4 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:04 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:04 user nova-compute[73121]:   <source dev="/dev/sdl"/>
Aug 15 02:03:04 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:04 user nova-compute[73121]:   <serial>422ba3f5-a5dd-4c69-af14-3f18cbb4029c</serial>
Aug 15 02:03:04 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 02:03:04 user nova-compute[73121]: </disk>
Aug 15 02:03:04 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Successfully detached device vdb from instance 793cddda-b586-4601-9f22-47938c9ccfb4 from the persistent domain config.
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 793cddda-b586-4601-9f22-47938c9ccfb4 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:04 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:04 user nova-compute[73121]:   <source dev="/dev/sdl"/>
Aug 15 02:03:04 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:04 user nova-compute[73121]:   <serial>422ba3f5-a5dd-4c69-af14-3f18cbb4029c</serial>
Aug 15 02:03:04 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 02:03:04 user nova-compute[73121]: </disk>
Aug 15 02:03:04 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Instance destroyed successfully.
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.objects.instance [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lazy-loading 'resources' on Instance uuid d7d7ea92-e89a-43cb-8e41-b983fa788244 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-373463171',display_name='tempest-AttachSCSIVolumeTestJSON-server-373463171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-373463171',id=5,image_ref='1504a059-e5fa-4095-90ae-d13cf3efea37',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8JQuwZ9/OPqrYML4nhtr7q3kY6HosKDlFWo1msv12FcG0eDtbagC6d66CW1TiMkqrAUqaDGugqhztuaMLfk1/dnh4Awm14XfVyMsux/NzJrVRDOFhLlN4fdGlixi7x3A==',key_name='tempest-keypair-451795057',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ecf865dc7f4b4d48a30216bb550aeee3',ramdisk_id='',reservation_id='r-f3mtig76',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1504a059-e5fa-4095-90ae-d13cf3efea37',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1428843306',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1428843306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:01:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b01588a70d544b7297f29dc5dc14dfc2',uuid=d7d7ea92-e89a-43cb-8e41-b983fa788244,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Converting VIF {"id": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "address": "fa:16:3e:97:33:47", "network": {"id": "8b0ca458-0ccd-42de-8db3-ee5a90c1aeae", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1312551815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ecf865dc7f4b4d48a30216bb550aeee3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896e7b3e-1b", "ovs_interfaceid": "896e7b3e-1b88-4a65-bdc2-06a5045a43f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:33:47,bridge_name='br-int',has_traffic_filtering=True,id=896e7b3e-1b88-4a65-bdc2-06a5045a43f6,network=Network(8b0ca458-0ccd-42de-8db3-ee5a90c1aeae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896e7b3e-1b') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_vif [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:33:47,bridge_name='br-int',has_traffic_filtering=True,id=896e7b3e-1b88-4a65-bdc2-06a5045a43f6,network=Network(8b0ca458-0ccd-42de-8db3-ee5a90c1aeae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896e7b3e-1b') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap896e7b3e-1b, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:04 user nova-compute[73121]: INFO os_vif [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:33:47,bridge_name='br-int',has_traffic_filtering=True,id=896e7b3e-1b88-4a65-bdc2-06a5045a43f6,network=Network(8b0ca458-0ccd-42de-8db3-ee5a90c1aeae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896e7b3e-1b')
Aug 15 02:03:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Deleting instance files /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244_del
Aug 15 02:03:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Deletion of /opt/stack/data/nova/instances/d7d7ea92-e89a-43cb-8e41-b983fa788244_del complete
Aug 15 02:03:04 user nova-compute[73121]: INFO nova.compute.manager [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692064984.7809165, 793cddda-b586-4601-9f22-47938c9ccfb4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:03:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Successfully detached device vdb from instance 793cddda-b586-4601-9f22-47938c9ccfb4 from the live domain config.
Aug 15 02:03:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvdlMPqo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:04 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25f2fcd-44c4-49de-a33f-eb39e9d4647b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd90bf51-8736-4a2d-aa95-318a5b9239fa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:04 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:04 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:04 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e34cdd360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c'): ({'sdl'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Removing single pathed devices sdl {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4808ff03-ed8f-49a8-854c-0d3f953b6090]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb45b9ab-c6ef-437f-bb52-32eadf4e5579]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Flushing IO for device /dev/sdl {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9a1fa8-2e21-4a75-8e50-bcd961afb62c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.043s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eca29ce-d59e-4d78-9f65-9abd9a63e846]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] SCSI volumes sdl have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[661dde2e-541f-4422-bd67-ff50f071433f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be2fecd-47c3-44dc-843a-ba2cb3e5678a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c, portal: 172.16.0.220,3260]
Aug 15 02:03:05 user nova-compute[73121]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:05 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:422ba3f5-a5dd-4c69-af14-3f18cbb4029c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f1721a-7031-41e8-b779-956e0a79d4b1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] <== disconnect_volume: return (351ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG nova.objects.instance [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lazy-loading 'flavor' on Instance uuid 66e5ded4-d25e-443f-b000-df3b693555dd {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-55a5a7b8-49c0-4bca-906e-36f4c21057f9 tempest-VolumesAssistedSnapshotsTest-1143139535 tempest-VolumesAssistedSnapshotsTest-1143139535-project-admin] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.014s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:05 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Took 0.97 seconds to deallocate network for instance.
Aug 15 02:03:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-8e83d1e7-aba7-423a-8cc0-25de58acca61 req-231c9dc6-9403-4cc9-af6f-a32b46546024 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received event network-vif-deleted-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:05 user nova-compute[73121]: INFO nova.compute.manager [req-8e83d1e7-aba7-423a-8cc0-25de58acca61 req-231c9dc6-9403-4cc9-af6f-a32b46546024 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Neutron deleted interface 896e7b3e-1b88-4a65-bdc2-06a5045a43f6; detaching it from the instance and deleting it from the info cache
Aug 15 02:03:05 user nova-compute[73121]: DEBUG nova.network.neutron [req-8e83d1e7-aba7-423a-8cc0-25de58acca61 req-231c9dc6-9403-4cc9-af6f-a32b46546024 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-8e83d1e7-aba7-423a-8cc0-25de58acca61 req-231c9dc6-9403-4cc9-af6f-a32b46546024 service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Detach interface failed, port_id=896e7b3e-1b88-4a65-bdc2-06a5045a43f6, reason: Instance d7d7ea92-e89a-43cb-8e41-b983fa788244 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:03:05 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:06 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Deleted allocations for instance d7d7ea92-e89a-43cb-8e41-b983fa788244
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-8a9e1fe1-ad0b-4a65-a823-d152d7b49080 req-1a755feb-3ffb-4568-82c0-c5ccdec2574c service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received event network-vif-plugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8a9e1fe1-ad0b-4a65-a823-d152d7b49080 req-1a755feb-3ffb-4568-82c0-c5ccdec2574c service nova] Acquiring lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8a9e1fe1-ad0b-4a65-a823-d152d7b49080 req-1a755feb-3ffb-4568-82c0-c5ccdec2574c service nova] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8a9e1fe1-ad0b-4a65-a823-d152d7b49080 req-1a755feb-3ffb-4568-82c0-c5ccdec2574c service nova] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-8a9e1fe1-ad0b-4a65-a823-d152d7b49080 req-1a755feb-3ffb-4568-82c0-c5ccdec2574c service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] No waiting events found dispatching network-vif-plugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:06 user nova-compute[73121]: WARNING nova.compute.manager [req-8a9e1fe1-ad0b-4a65-a823-d152d7b49080 req-1a755feb-3ffb-4568-82c0-c5ccdec2574c service nova] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Received unexpected event network-vif-plugged-896e7b3e-1b88-4a65-bdc2-06a5045a43f6 for instance with vm_state deleted and task_state None.
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lazy-loading 'flavor' on Instance uuid 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4cc34bd4-b179-4c69-a431-832f6f9e36b1 tempest-AttachSCSIVolumeTestJSON-1428843306 tempest-AttachSCSIVolumeTestJSON-1428843306-project-member] Lock "d7d7ea92-e89a-43cb-8e41-b983fa788244" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.606s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5571bcd9-68d3-45b5-bc31-031768ca30b7 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.135s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "interface-793cddda-b586-4601-9f22-47938c9ccfb4-4231262d-1a27-45f5-818a-f73f46523c16" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "interface-793cddda-b586-4601-9f22-47938c9ccfb4-4231262d-1a27-45f5-818a-f73f46523c16" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.objects.instance [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lazy-loading 'flavor' on Instance uuid 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1318082023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1318082023',id=6,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaNdyYz27xk+rfspm0CM27aYjNNYrCrxWXHlEOIfv3Q6WatZXVBNwBJYMUI8ec6jJvv3xvpG28G35Inoo6iygE/loMQdezawYx8ddyYXrAFA1EYbDFxyVvB9BTw1fLZcA==',key_name='tempest-keypair-479875827',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='728a7726790042c99e4bd53c2967ee96',ramdisk_id='',reservation_id='r-16w40iyx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2030671207',owner_user_name='tempest-TaggedAttachmentsTest-2030671207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7967084f3b954a739fef6956a789cbad',uuid=793cddda-b586-4601-9f22-47938c9ccfb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converting VIF {"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:b8:a1,bridge_name='br-int',has_traffic_filtering=True,id=4231262d-1a27-45f5-818a-f73f46523c16,network=Network(7b553a96-cbf9-475f-bf30-1edeacec3051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4231262d-1a') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:b8:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap4231262d-1a"/></interface> {{(pid=73121) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:b8:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap4231262d-1a"/></interface> {{(pid=73121) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Attempting to detach device tap4231262d-1a from instance 793cddda-b586-4601-9f22-47938c9ccfb4 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] detach device xml: <interface type="ethernet">
Aug 15 02:03:06 user nova-compute[73121]:   <mac address="fa:16:3e:8b:b8:a1"/>
Aug 15 02:03:06 user nova-compute[73121]:   <model type="virtio"/>
Aug 15 02:03:06 user nova-compute[73121]:   <mtu size="1442"/>
Aug 15 02:03:06 user nova-compute[73121]:   <target dev="tap4231262d-1a"/>
Aug 15 02:03:06 user nova-compute[73121]: </interface>
Aug 15 02:03:06 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:b8:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap4231262d-1a"/></interface> {{(pid=73121) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8b:b8:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap4231262d-1a"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 15 02:03:06 user nova-compute[73121]:   <name>instance-00000006</name>
Aug 15 02:03:06 user nova-compute[73121]:   <uuid>793cddda-b586-4601-9f22-47938c9ccfb4</uuid>
Aug 15 02:03:06 user nova-compute[73121]:   <metadata>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:03:06 user nova-compute[73121]:   <nova:package version="0.0.0"/>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:name>tempest-device-tagging-server-1318082023</nova:name>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:creationTime>2023-08-15 02:02:46</nova:creationTime>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:flavor name="m1.tiny">
Aug 15 02:03:06 user nova-compute[73121]:     <nova:memory>512</nova:memory>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:disk>1</nova:disk>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:swap>0</nova:swap>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:vcpus>1</nova:vcpus>
Aug 15 02:03:06 user nova-compute[73121]:   </nova:flavor>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:owner>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:user uuid="7967084f3b954a739fef6956a789cbad">tempest-TaggedAttachmentsTest-2030671207-project-member</nova:user>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:project uuid="728a7726790042c99e4bd53c2967ee96">tempest-TaggedAttachmentsTest-2030671207</nova:project>
Aug 15 02:03:06 user nova-compute[73121]:   </nova:owner>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:ports>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:port uuid="1c8be17e-3242-49dd-b0b0-cd0834cf845c">
Aug 15 02:03:06 user nova-compute[73121]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 02:03:06 user nova-compute[73121]:     </nova:port>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:port uuid="4231262d-1a27-45f5-818a-f73f46523c16">
Aug 15 02:03:06 user nova-compute[73121]:       <nova:ip type="fixed" address="10.10.10.204" ipVersion="4"/>
Aug 15 02:03:06 user nova-compute[73121]:     </nova:port>
Aug 15 02:03:06 user nova-compute[73121]:   </nova:ports>
Aug 15 02:03:06 user nova-compute[73121]: </nova:instance>
Aug 15 02:03:06 user nova-compute[73121]:   </metadata>
Aug 15 02:03:06 user nova-compute[73121]:   <memory unit='KiB'>524288</memory>
Aug 15 02:03:06 user nova-compute[73121]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 02:03:06 user nova-compute[73121]:   <vcpu placement='static'>1</vcpu>
Aug 15 02:03:06 user nova-compute[73121]:   <resource>
Aug 15 02:03:06 user nova-compute[73121]:     <partition>/machine</partition>
Aug 15 02:03:06 user nova-compute[73121]:   </resource>
Aug 15 02:03:06 user nova-compute[73121]:   <sysinfo type='smbios'>
Aug 15 02:03:06 user nova-compute[73121]:     <system>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='version'>0.0.0</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='serial'>793cddda-b586-4601-9f22-47938c9ccfb4</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='uuid'>793cddda-b586-4601-9f22-47938c9ccfb4</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='family'>Virtual Machine</entry>
Aug 15 02:03:06 user nova-compute[73121]:     </system>
Aug 15 02:03:06 user nova-compute[73121]:   </sysinfo>
Aug 15 02:03:06 user nova-compute[73121]:   <os>
Aug 15 02:03:06 user nova-compute[73121]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 02:03:06 user nova-compute[73121]:     <boot dev='hd'/>
Aug 15 02:03:06 user nova-compute[73121]:     <smbios mode='sysinfo'/>
Aug 15 02:03:06 user nova-compute[73121]:   </os>
Aug 15 02:03:06 user nova-compute[73121]:   <features>
Aug 15 02:03:06 user nova-compute[73121]:     <acpi/>
Aug 15 02:03:06 user nova-compute[73121]:     <apic/>
Aug 15 02:03:06 user nova-compute[73121]:     <vmcoreinfo state='on'/>
Aug 15 02:03:06 user nova-compute[73121]:   </features>
Aug 15 02:03:06 user nova-compute[73121]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 02:03:06 user nova-compute[73121]:     <model fallback='forbid'>Nehalem</model>
Aug 15 02:03:06 user nova-compute[73121]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 02:03:06 user nova-compute[73121]:     <feature policy='require' name='vme'/>
Aug 15 02:03:06 user nova-compute[73121]:     <feature policy='require' name='x2apic'/>
Aug 15 02:03:06 user nova-compute[73121]:     <feature policy='require' name='hypervisor'/>
Aug 15 02:03:06 user nova-compute[73121]:   </cpu>
Aug 15 02:03:06 user nova-compute[73121]:   <clock offset='utc'>
Aug 15 02:03:06 user nova-compute[73121]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 02:03:06 user nova-compute[73121]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 02:03:06 user nova-compute[73121]:     <timer name='hpet' present='no'/>
Aug 15 02:03:06 user nova-compute[73121]:   </clock>
Aug 15 02:03:06 user nova-compute[73121]:   <on_poweroff>destroy</on_poweroff>
Aug 15 02:03:06 user nova-compute[73121]:   <on_reboot>restart</on_reboot>
Aug 15 02:03:06 user nova-compute[73121]:   <on_crash>destroy</on_crash>
Aug 15 02:03:06 user nova-compute[73121]:   <devices>
Aug 15 02:03:06 user nova-compute[73121]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 02:03:06 user nova-compute[73121]:     <disk type='file' device='disk'>
Aug 15 02:03:06 user nova-compute[73121]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 02:03:06 user nova-compute[73121]:       <source file='/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk' index='2'/>
Aug 15 02:03:06 user nova-compute[73121]:       <backingStore type='file' index='3'>
Aug 15 02:03:06 user nova-compute[73121]:         <format type='raw'/>
Aug 15 02:03:06 user nova-compute[73121]:         <source file='/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a'/>
Aug 15 02:03:06 user nova-compute[73121]:         <backingStore/>
Aug 15 02:03:06 user nova-compute[73121]:       </backingStore>
Aug 15 02:03:06 user nova-compute[73121]:       <target dev='vda' bus='virtio'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='virtio-disk0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </disk>
Aug 15 02:03:06 user nova-compute[73121]:     <disk type='file' device='cdrom'>
Aug 15 02:03:06 user nova-compute[73121]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 02:03:06 user nova-compute[73121]:       <source file='/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk.config' index='1'/>
Aug 15 02:03:06 user nova-compute[73121]:       <backingStore/>
Aug 15 02:03:06 user nova-compute[73121]:       <target dev='hda' bus='ide'/>
Aug 15 02:03:06 user nova-compute[73121]:       <readonly/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='ide0-0-0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </disk>
Aug 15 02:03:06 user nova-compute[73121]:     <controller type='usb' index='0' model='none'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='usb'/>
Aug 15 02:03:06 user nova-compute[73121]:     </controller>
Aug 15 02:03:06 user nova-compute[73121]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='pci.0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </controller>
Aug 15 02:03:06 user nova-compute[73121]:     <controller type='ide' index='0'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='ide'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 02:03:06 user nova-compute[73121]:     </controller>
Aug 15 02:03:06 user nova-compute[73121]:     <interface type='ethernet'>
Aug 15 02:03:06 user nova-compute[73121]:       <mac address='fa:16:3e:a4:6b:67'/>
Aug 15 02:03:06 user nova-compute[73121]:       <target dev='tap1c8be17e-32'/>
Aug 15 02:03:06 user nova-compute[73121]:       <model type='virtio'/>
Aug 15 02:03:06 user nova-compute[73121]:       <mtu size='1442'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='net0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </interface>
Aug 15 02:03:06 user nova-compute[73121]:     <interface type='ethernet'>
Aug 15 02:03:06 user nova-compute[73121]:       <mac address='fa:16:3e:8b:b8:a1'/>
Aug 15 02:03:06 user nova-compute[73121]:       <target dev='tap4231262d-1a'/>
Aug 15 02:03:06 user nova-compute[73121]:       <model type='virtio'/>
Aug 15 02:03:06 user nova-compute[73121]:       <mtu size='1442'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='net1'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </interface>
Aug 15 02:03:06 user nova-compute[73121]:     <serial type='pty'>
Aug 15 02:03:06 user nova-compute[73121]:       <source path='/dev/pts/5'/>
Aug 15 02:03:06 user nova-compute[73121]:       <log file='/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/console.log' append='off'/>
Aug 15 02:03:06 user nova-compute[73121]:       <target type='isa-serial' port='0'>
Aug 15 02:03:06 user nova-compute[73121]:         <model name='isa-serial'/>
Aug 15 02:03:06 user nova-compute[73121]:       </target>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='serial0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </serial>
Aug 15 02:03:06 user nova-compute[73121]:     <console type='pty' tty='/dev/pts/5'>
Aug 15 02:03:06 user nova-compute[73121]:       <source path='/dev/pts/5'/>
Aug 15 02:03:06 user nova-compute[73121]:       <log file='/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/console.log' append='off'/>
Aug 15 02:03:06 user nova-compute[73121]:       <target type='serial' port='0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='serial0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </console>
Aug 15 02:03:06 user nova-compute[73121]:     <input type='mouse' bus='ps2'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='input0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </input>
Aug 15 02:03:06 user nova-compute[73121]:     <input type='keyboard' bus='ps2'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='input1'/>
Aug 15 02:03:06 user nova-compute[73121]:     </input>
Aug 15 02:03:06 user nova-compute[73121]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 15 02:03:06 user nova-compute[73121]:       <listen type='address' address='0.0.0.0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </graphics>
Aug 15 02:03:06 user nova-compute[73121]:     <audio id='1' type='none'/>
Aug 15 02:03:06 user nova-compute[73121]:     <video>
Aug 15 02:03:06 user nova-compute[73121]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='video0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </video>
Aug 15 02:03:06 user nova-compute[73121]:     <memballoon model='virtio'>
Aug 15 02:03:06 user nova-compute[73121]:       <stats period='10'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='balloon0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </memballoon>
Aug 15 02:03:06 user nova-compute[73121]:     <rng model='virtio'>
Aug 15 02:03:06 user nova-compute[73121]:       <backend model='random'>/dev/urandom</backend>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='rng0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </rng>
Aug 15 02:03:06 user nova-compute[73121]:   </devices>
Aug 15 02:03:06 user nova-compute[73121]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 02:03:06 user nova-compute[73121]:     <label>libvirt-793cddda-b586-4601-9f22-47938c9ccfb4</label>
Aug 15 02:03:06 user nova-compute[73121]:     <imagelabel>libvirt-793cddda-b586-4601-9f22-47938c9ccfb4</imagelabel>
Aug 15 02:03:06 user nova-compute[73121]:   </seclabel>
Aug 15 02:03:06 user nova-compute[73121]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 02:03:06 user nova-compute[73121]:     <label>+64055:+108</label>
Aug 15 02:03:06 user nova-compute[73121]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 02:03:06 user nova-compute[73121]:   </seclabel>
Aug 15 02:03:06 user nova-compute[73121]: </domain>
Aug 15 02:03:06 user nova-compute[73121]:  {{(pid=73121) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 02:03:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Successfully detached device tap4231262d-1a from instance 793cddda-b586-4601-9f22-47938c9ccfb4 from the persistent domain config.
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] (1/8): Attempting to detach device tap4231262d-1a with device alias net1 from instance 793cddda-b586-4601-9f22-47938c9ccfb4 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] detach device xml: <interface type="ethernet">
Aug 15 02:03:06 user nova-compute[73121]:   <mac address="fa:16:3e:8b:b8:a1"/>
Aug 15 02:03:06 user nova-compute[73121]:   <model type="virtio"/>
Aug 15 02:03:06 user nova-compute[73121]:   <mtu size="1442"/>
Aug 15 02:03:06 user nova-compute[73121]:   <target dev="tap4231262d-1a"/>
Aug 15 02:03:06 user nova-compute[73121]: </interface>
Aug 15 02:03:06 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692064986.656633, 793cddda-b586-4601-9f22-47938c9ccfb4 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Start waiting for the detach event from libvirt for device tap4231262d-1a with device alias net1 for instance 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8b:b8:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap4231262d-1a"/></interface> {{(pid=73121) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8b:b8:a1"/><model type="virtio"/><mtu size="1442"/><target dev="tap4231262d-1a"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 15 02:03:06 user nova-compute[73121]:   <name>instance-00000006</name>
Aug 15 02:03:06 user nova-compute[73121]:   <uuid>793cddda-b586-4601-9f22-47938c9ccfb4</uuid>
Aug 15 02:03:06 user nova-compute[73121]:   <metadata>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:03:06 user nova-compute[73121]:   <nova:package version="0.0.0"/>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:name>tempest-device-tagging-server-1318082023</nova:name>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:creationTime>2023-08-15 02:02:46</nova:creationTime>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:flavor name="m1.tiny">
Aug 15 02:03:06 user nova-compute[73121]:     <nova:memory>512</nova:memory>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:disk>1</nova:disk>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:swap>0</nova:swap>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:vcpus>1</nova:vcpus>
Aug 15 02:03:06 user nova-compute[73121]:   </nova:flavor>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:owner>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:user uuid="7967084f3b954a739fef6956a789cbad">tempest-TaggedAttachmentsTest-2030671207-project-member</nova:user>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:project uuid="728a7726790042c99e4bd53c2967ee96">tempest-TaggedAttachmentsTest-2030671207</nova:project>
Aug 15 02:03:06 user nova-compute[73121]:   </nova:owner>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:ports>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:port uuid="1c8be17e-3242-49dd-b0b0-cd0834cf845c">
Aug 15 02:03:06 user nova-compute[73121]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 02:03:06 user nova-compute[73121]:     </nova:port>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:port uuid="4231262d-1a27-45f5-818a-f73f46523c16">
Aug 15 02:03:06 user nova-compute[73121]:       <nova:ip type="fixed" address="10.10.10.204" ipVersion="4"/>
Aug 15 02:03:06 user nova-compute[73121]:     </nova:port>
Aug 15 02:03:06 user nova-compute[73121]:   </nova:ports>
Aug 15 02:03:06 user nova-compute[73121]: </nova:instance>
Aug 15 02:03:06 user nova-compute[73121]:   </metadata>
Aug 15 02:03:06 user nova-compute[73121]:   <memory unit='KiB'>524288</memory>
Aug 15 02:03:06 user nova-compute[73121]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 02:03:06 user nova-compute[73121]:   <vcpu placement='static'>1</vcpu>
Aug 15 02:03:06 user nova-compute[73121]:   <resource>
Aug 15 02:03:06 user nova-compute[73121]:     <partition>/machine</partition>
Aug 15 02:03:06 user nova-compute[73121]:   </resource>
Aug 15 02:03:06 user nova-compute[73121]:   <sysinfo type='smbios'>
Aug 15 02:03:06 user nova-compute[73121]:     <system>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='version'>0.0.0</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='serial'>793cddda-b586-4601-9f22-47938c9ccfb4</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='uuid'>793cddda-b586-4601-9f22-47938c9ccfb4</entry>
Aug 15 02:03:06 user nova-compute[73121]:       <entry name='family'>Virtual Machine</entry>
Aug 15 02:03:06 user nova-compute[73121]:     </system>
Aug 15 02:03:06 user nova-compute[73121]:   </sysinfo>
Aug 15 02:03:06 user nova-compute[73121]:   <os>
Aug 15 02:03:06 user nova-compute[73121]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 02:03:06 user nova-compute[73121]:     <boot dev='hd'/>
Aug 15 02:03:06 user nova-compute[73121]:     <smbios mode='sysinfo'/>
Aug 15 02:03:06 user nova-compute[73121]:   </os>
Aug 15 02:03:06 user nova-compute[73121]:   <features>
Aug 15 02:03:06 user nova-compute[73121]:     <acpi/>
Aug 15 02:03:06 user nova-compute[73121]:     <apic/>
Aug 15 02:03:06 user nova-compute[73121]:     <vmcoreinfo state='on'/>
Aug 15 02:03:06 user nova-compute[73121]:   </features>
Aug 15 02:03:06 user nova-compute[73121]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 02:03:06 user nova-compute[73121]:     <model fallback='forbid'>Nehalem</model>
Aug 15 02:03:06 user nova-compute[73121]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 02:03:06 user nova-compute[73121]:     <feature policy='require' name='vme'/>
Aug 15 02:03:06 user nova-compute[73121]:     <feature policy='require' name='x2apic'/>
Aug 15 02:03:06 user nova-compute[73121]:     <feature policy='require' name='hypervisor'/>
Aug 15 02:03:06 user nova-compute[73121]:   </cpu>
Aug 15 02:03:06 user nova-compute[73121]:   <clock offset='utc'>
Aug 15 02:03:06 user nova-compute[73121]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 02:03:06 user nova-compute[73121]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 02:03:06 user nova-compute[73121]:     <timer name='hpet' present='no'/>
Aug 15 02:03:06 user nova-compute[73121]:   </clock>
Aug 15 02:03:06 user nova-compute[73121]:   <on_poweroff>destroy</on_poweroff>
Aug 15 02:03:06 user nova-compute[73121]:   <on_reboot>restart</on_reboot>
Aug 15 02:03:06 user nova-compute[73121]:   <on_crash>destroy</on_crash>
Aug 15 02:03:06 user nova-compute[73121]:   <devices>
Aug 15 02:03:06 user nova-compute[73121]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 02:03:06 user nova-compute[73121]:     <disk type='file' device='disk'>
Aug 15 02:03:06 user nova-compute[73121]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 02:03:06 user nova-compute[73121]:       <source file='/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk' index='2'/>
Aug 15 02:03:06 user nova-compute[73121]:       <backingStore type='file' index='3'>
Aug 15 02:03:06 user nova-compute[73121]:         <format type='raw'/>
Aug 15 02:03:06 user nova-compute[73121]:         <source file='/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a'/>
Aug 15 02:03:06 user nova-compute[73121]:         <backingStore/>
Aug 15 02:03:06 user nova-compute[73121]:       </backingStore>
Aug 15 02:03:06 user nova-compute[73121]:       <target dev='vda' bus='virtio'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='virtio-disk0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </disk>
Aug 15 02:03:06 user nova-compute[73121]:     <disk type='file' device='cdrom'>
Aug 15 02:03:06 user nova-compute[73121]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 02:03:06 user nova-compute[73121]:       <source file='/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk.config' index='1'/>
Aug 15 02:03:06 user nova-compute[73121]:       <backingStore/>
Aug 15 02:03:06 user nova-compute[73121]:       <target dev='hda' bus='ide'/>
Aug 15 02:03:06 user nova-compute[73121]:       <readonly/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='ide0-0-0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </disk>
Aug 15 02:03:06 user nova-compute[73121]:     <controller type='usb' index='0' model='none'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='usb'/>
Aug 15 02:03:06 user nova-compute[73121]:     </controller>
Aug 15 02:03:06 user nova-compute[73121]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='pci.0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </controller>
Aug 15 02:03:06 user nova-compute[73121]:     <controller type='ide' index='0'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='ide'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 02:03:06 user nova-compute[73121]:     </controller>
Aug 15 02:03:06 user nova-compute[73121]:     <interface type='ethernet'>
Aug 15 02:03:06 user nova-compute[73121]:       <mac address='fa:16:3e:a4:6b:67'/>
Aug 15 02:03:06 user nova-compute[73121]:       <target dev='tap1c8be17e-32'/>
Aug 15 02:03:06 user nova-compute[73121]:       <model type='virtio'/>
Aug 15 02:03:06 user nova-compute[73121]:       <mtu size='1442'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='net0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </interface>
Aug 15 02:03:06 user nova-compute[73121]:     <serial type='pty'>
Aug 15 02:03:06 user nova-compute[73121]:       <source path='/dev/pts/5'/>
Aug 15 02:03:06 user nova-compute[73121]:       <log file='/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/console.log' append='off'/>
Aug 15 02:03:06 user nova-compute[73121]:       <target type='isa-serial' port='0'>
Aug 15 02:03:06 user nova-compute[73121]:         <model name='isa-serial'/>
Aug 15 02:03:06 user nova-compute[73121]:       </target>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='serial0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </serial>
Aug 15 02:03:06 user nova-compute[73121]:     <console type='pty' tty='/dev/pts/5'>
Aug 15 02:03:06 user nova-compute[73121]:       <source path='/dev/pts/5'/>
Aug 15 02:03:06 user nova-compute[73121]:       <log file='/opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/console.log' append='off'/>
Aug 15 02:03:06 user nova-compute[73121]:       <target type='serial' port='0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='serial0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </console>
Aug 15 02:03:06 user nova-compute[73121]:     <input type='mouse' bus='ps2'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='input0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </input>
Aug 15 02:03:06 user nova-compute[73121]:     <input type='keyboard' bus='ps2'>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='input1'/>
Aug 15 02:03:06 user nova-compute[73121]:     </input>
Aug 15 02:03:06 user nova-compute[73121]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 15 02:03:06 user nova-compute[73121]:       <listen type='address' address='0.0.0.0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </graphics>
Aug 15 02:03:06 user nova-compute[73121]:     <audio id='1' type='none'/>
Aug 15 02:03:06 user nova-compute[73121]:     <video>
Aug 15 02:03:06 user nova-compute[73121]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='video0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </video>
Aug 15 02:03:06 user nova-compute[73121]:     <memballoon model='virtio'>
Aug 15 02:03:06 user nova-compute[73121]:       <stats period='10'/>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='balloon0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </memballoon>
Aug 15 02:03:06 user nova-compute[73121]:     <rng model='virtio'>
Aug 15 02:03:06 user nova-compute[73121]:       <backend model='random'>/dev/urandom</backend>
Aug 15 02:03:06 user nova-compute[73121]:       <alias name='rng0'/>
Aug 15 02:03:06 user nova-compute[73121]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 02:03:06 user nova-compute[73121]:     </rng>
Aug 15 02:03:06 user nova-compute[73121]:   </devices>
Aug 15 02:03:06 user nova-compute[73121]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 02:03:06 user nova-compute[73121]:     <label>libvirt-793cddda-b586-4601-9f22-47938c9ccfb4</label>
Aug 15 02:03:06 user nova-compute[73121]:     <imagelabel>libvirt-793cddda-b586-4601-9f22-47938c9ccfb4</imagelabel>
Aug 15 02:03:06 user nova-compute[73121]:   </seclabel>
Aug 15 02:03:06 user nova-compute[73121]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 02:03:06 user nova-compute[73121]:     <label>+64055:+108</label>
Aug 15 02:03:06 user nova-compute[73121]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 02:03:06 user nova-compute[73121]:   </seclabel>
Aug 15 02:03:06 user nova-compute[73121]: </domain>
Aug 15 02:03:06 user nova-compute[73121]:  {{(pid=73121) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 02:03:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Successfully detached device tap4231262d-1a from instance 793cddda-b586-4601-9f22-47938c9ccfb4 from the live domain config.
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1318082023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1318082023',id=6,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaNdyYz27xk+rfspm0CM27aYjNNYrCrxWXHlEOIfv3Q6WatZXVBNwBJYMUI8ec6jJvv3xvpG28G35Inoo6iygE/loMQdezawYx8ddyYXrAFA1EYbDFxyVvB9BTw1fLZcA==',key_name='tempest-keypair-479875827',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='728a7726790042c99e4bd53c2967ee96',ramdisk_id='',reservation_id='r-16w40iyx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2030671207',owner_user_name='tempest-TaggedAttachmentsTest-2030671207-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7967084f3b954a739fef6956a789cbad',uuid=793cddda-b586-4601-9f22-47938c9ccfb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converting VIF {"id": "4231262d-1a27-45f5-818a-f73f46523c16", "address": "fa:16:3e:8b:b8:a1", "network": {"id": "7b553a96-cbf9-475f-bf30-1edeacec3051", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1711795290", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4231262d-1a", "ovs_interfaceid": "4231262d-1a27-45f5-818a-f73f46523c16", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:b8:a1,bridge_name='br-int',has_traffic_filtering=True,id=4231262d-1a27-45f5-818a-f73f46523c16,network=Network(7b553a96-cbf9-475f-bf30-1edeacec3051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4231262d-1a') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG os_vif [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:b8:a1,bridge_name='br-int',has_traffic_filtering=True,id=4231262d-1a27-45f5-818a-f73f46523c16,network=Network(7b553a96-cbf9-475f-bf30-1edeacec3051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4231262d-1a') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4231262d-1a, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:06 user nova-compute[73121]: INFO os_vif [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:b8:a1,bridge_name='br-int',has_traffic_filtering=True,id=4231262d-1a27-45f5-818a-f73f46523c16,network=Network(7b553a96-cbf9-475f-bf30-1edeacec3051),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4231262d-1a')
Aug 15 02:03:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:03:06 user nova-compute[73121]:   <nova:package version="0.0.0"/>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:name>tempest-device-tagging-server-1318082023</nova:name>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:creationTime>2023-08-15 02:03:06</nova:creationTime>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:flavor name="m1.tiny">
Aug 15 02:03:06 user nova-compute[73121]:     <nova:memory>512</nova:memory>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:disk>1</nova:disk>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:swap>0</nova:swap>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:vcpus>1</nova:vcpus>
Aug 15 02:03:06 user nova-compute[73121]:   </nova:flavor>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:owner>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:user uuid="7967084f3b954a739fef6956a789cbad">tempest-TaggedAttachmentsTest-2030671207-project-member</nova:user>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:project uuid="728a7726790042c99e4bd53c2967ee96">tempest-TaggedAttachmentsTest-2030671207</nova:project>
Aug 15 02:03:06 user nova-compute[73121]:   </nova:owner>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:03:06 user nova-compute[73121]:   <nova:ports>
Aug 15 02:03:06 user nova-compute[73121]:     <nova:port uuid="1c8be17e-3242-49dd-b0b0-cd0834cf845c">
Aug 15 02:03:06 user nova-compute[73121]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 02:03:06 user nova-compute[73121]:     </nova:port>
Aug 15 02:03:06 user nova-compute[73121]:   </nova:ports>
Aug 15 02:03:06 user nova-compute[73121]: </nova:instance>
Aug 15 02:03:06 user nova-compute[73121]:  {{(pid=73121) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 02:03:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-unplugged-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] No waiting events found dispatching network-vif-unplugged-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:07 user nova-compute[73121]: WARNING nova.compute.manager [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received unexpected event network-vif-unplugged-4231262d-1a27-45f5-818a-f73f46523c16 for instance with vm_state active and task_state None.
Aug 15 02:03:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-plugged-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] No waiting events found dispatching network-vif-plugged-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:07 user nova-compute[73121]: WARNING nova.compute.manager [req-72260334-3d95-4472-b74d-310f394004db req-5c4108ff-0f39-4dff-89df-be1cdf6e2ba2 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received unexpected event network-vif-plugged-4231262d-1a27-45f5-818a-f73f46523c16 for instance with vm_state active and task_state None.
Aug 15 02:03:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquired lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:03:07 user nova-compute[73121]: DEBUG nova.network.neutron [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:03:08 user nova-compute[73121]: INFO nova.network.neutron [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Port 4231262d-1a27-45f5-818a-f73f46523c16 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 15 02:03:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updating instance_info_cache with network_info: [{"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Releasing lock "refresh_cache-793cddda-b586-4601-9f22-47938c9ccfb4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:03:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3cb08e5a-b91f-4e23-b812-7e3187eae7a1 tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "interface-793cddda-b586-4601-9f22-47938c9ccfb4-4231262d-1a27-45f5-818a-f73f46523c16" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.014s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-a9aaa3a0-13a8-4947-947a-ee1786433b2f req-c2bc863f-2d06-4b6f-82be-cc11e648d45d service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-changed-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-a9aaa3a0-13a8-4947-947a-ee1786433b2f req-c2bc863f-2d06-4b6f-82be-cc11e648d45d service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Refreshing instance network info cache due to event network-changed-079356b3-bcfd-429d-a9bd-4f2c93cbf563. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a9aaa3a0-13a8-4947-947a-ee1786433b2f req-c2bc863f-2d06-4b6f-82be-cc11e648d45d service nova] Acquiring lock "refresh_cache-77c8cd9b-475e-4293-9050-c1b2cd8ed015" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a9aaa3a0-13a8-4947-947a-ee1786433b2f req-c2bc863f-2d06-4b6f-82be-cc11e648d45d service nova] Acquired lock "refresh_cache-77c8cd9b-475e-4293-9050-c1b2cd8ed015" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-a9aaa3a0-13a8-4947-947a-ee1786433b2f req-c2bc863f-2d06-4b6f-82be-cc11e648d45d service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Refreshing network info cache for port 079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YsLvTkBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:09 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:09 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:09 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrwUTFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:09 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8bd38f-4962-4a51-9987-8662b5c85085]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:03:09 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed656800-e8fc-4acb-93c4-bbc5ecea38f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700] added
Aug 15 02:03:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b928cf8b-fe94-4ed2-8fed-03cd85c86ad8]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7e24a2-5c2f-4b60-a43b-3596e3b4160c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YsLvTkBp {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YsLvTkBp" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cdd115-21ce-4966-a1cd-f1a000f0ff4d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YsLvTkBp'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-4b55302f-8dbe-407b-bedf-42fd5db7ad4f req-01eb45c1-459e-49ab-84ca-2e4881cd945e service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-deleted-4231262d-1a27-45f5-818a-f73f46523c16 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba034217-f2e2-477f-9063-b6eb082124e5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a41d88-0b13-414c-8e2a-d7459cff9f4b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bd88cf-f50d-4bbc-85f1-f2fcdd0e9e66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700, portal: 172.16.0.220,3260]
Aug 15 02:03:09 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5688521-652e-4939-9b1c-ef2251a52fe0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c95897a-9ed6-4e3b-b676-f593a4af7499]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:09 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] HCTL ('41', '-', '-', 0) found on session 14 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac37366-875e-4fc8-bd3d-75d4a86535e2]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Searching for a device in session 14 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:03:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YsLvTkBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:03:10 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:03:10 user nova-compute[73121]: DEBUG nova.network.neutron [req-a9aaa3a0-13a8-4947-947a-ee1786433b2f req-c2bc863f-2d06-4b6f-82be-cc11e648d45d service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Updated VIF entry in instance network info cache for port 079356b3-bcfd-429d-a9bd-4f2c93cbf563. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:03:10 user nova-compute[73121]: DEBUG nova.network.neutron [req-a9aaa3a0-13a8-4947-947a-ee1786433b2f req-c2bc863f-2d06-4b6f-82be-cc11e648d45d service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Updating instance_info_cache with network_info: [{"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a9aaa3a0-13a8-4947-947a-ee1786433b2f req-c2bc863f-2d06-4b6f-82be-cc11e648d45d service nova] Releasing lock "refresh_cache-77c8cd9b-475e-4293-9050-c1b2cd8ed015" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:03:10 user nova-compute[73121]: INFO nova.compute.manager [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Rebuilding instance
Aug 15 02:03:10 user nova-compute[73121]: DEBUG nova.objects.instance [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 77c8cd9b-475e-4293-9050-c1b2cd8ed015 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:10 user nova-compute[73121]: DEBUG nova.compute.manager [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.524s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] <== connect_volume: return (1526ms) {'type': 'block', 'scsi_wwn': '23934316366383964', 'path': '/dev/sdj'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934316366383964', 'path': '/dev/sdj'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lazy-loading 'pci_requests' on Instance uuid 77c8cd9b-475e-4293-9050-c1b2cd8ed015 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.515s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:11 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:11 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lazy-loading 'pci_devices' on Instance uuid 77c8cd9b-475e-4293-9050-c1b2cd8ed015 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lazy-loading 'flavor' on Instance uuid 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lazy-loading 'resources' on Instance uuid 77c8cd9b-475e-4293-9050-c1b2cd8ed015 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0110def2-222b-4013-889b-17a17b2589b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:03:11 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lazy-loading 'migration_context' on Instance uuid 77c8cd9b-475e-4293-9050-c1b2cd8ed015 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b9a470-8867-4a56-8686-26b502f6d072]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd] added
Aug 15 02:03:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73121) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:03:11 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:11 user nova-compute[73121]:   <source dev="/dev/sdj"/>
Aug 15 02:03:11 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:11 user nova-compute[73121]:   <serial>a535e004-46f7-4d67-aa64-09e4c9a05700</serial>
Aug 15 02:03:11 user nova-compute[73121]: </disk>
Aug 15 02:03:11 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ca11de-f904-430c-ac6e-d5e05a3ccb54]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a5bca2-be39-4490-ba65-3b233809a914]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYrwUTFX {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYrwUTFX" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c470a027-532d-4618-95f5-6139d77103df]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYrwUTFX'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda76ab4-7c44-484c-b4eb-37546da0d05d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[665b217c-e20c-40c9-aba1-f90f1aaaa052]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --login" returned: 0 in 0.124s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d466175a-b38b-40b9-ba44-48bf49774e00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260]
Aug 15 02:03:11 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc8370c-34ad-453c-96df-14827a2bbe4a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7d2f41-e3cc-4e91-bc7a-9b17e9f2977f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:11 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] HCTL ('42', '-', '-', 0) found on session 15 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-5e83fa0c-b2ca-4acd-9036-b0d6f97876b3 req-d91751fc-c4ff-485f-a505-4a72397bd53c service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-unplugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5e83fa0c-b2ca-4acd-9036-b0d6f97876b3 req-d91751fc-c4ff-485f-a505-4a72397bd53c service nova] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5e83fa0c-b2ca-4acd-9036-b0d6f97876b3 req-d91751fc-c4ff-485f-a505-4a72397bd53c service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5e83fa0c-b2ca-4acd-9036-b0d6f97876b3 req-d91751fc-c4ff-485f-a505-4a72397bd53c service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-5e83fa0c-b2ca-4acd-9036-b0d6f97876b3 req-d91751fc-c4ff-485f-a505-4a72397bd53c service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] No waiting events found dispatching network-vif-unplugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:11 user nova-compute[73121]: WARNING nova.compute.manager [req-5e83fa0c-b2ca-4acd-9036-b0d6f97876b3 req-d91751fc-c4ff-485f-a505-4a72397bd53c service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received unexpected event network-vif-unplugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 for instance with vm_state active and task_state rebuilding.
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeb26b3-9715-478f-b659-7e2541b04611]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Searching for a device in session 15 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Connected to sdk using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrwUTFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] No VIF found with MAC fa:16:3e:9e:5a:f2, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae51cb5f-9c47-4e27-b885-4e0d873bf2a9 tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.886s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Updating instance_info_cache with network_info: [{"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:03:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance destroyed successfully.
Aug 15 02:03:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance destroyed successfully.
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1859624349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1099324202',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ8gEcMQAH0kKvlLTqDFoN126Q1iu/zZMIuFDLU7xxMwHV9ltLkgiaYzVdoyUTSZfNI34Auws52ZGHaGrri6N4rWPVwa87e5xkWI9k4aKald8BQ17zxIwAGqGM5Rgk/GA==',key_name='tempest-keypair-1468421416',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a213fca0e8144873a2a412a9348d4d20',ramdisk_id='',reservation_id='r-qzagwdto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-776954851',owner_user_name='tempest-ServerActionsV293TestJSON-776954851-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e0a6842bb14afda109782b1e26eaa9',uuid=77c8cd9b-475e-4293-9050-c1b2cd8ed015,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converting VIF {"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_vif [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap079356b3-bc, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:11 user nova-compute[73121]: INFO os_vif [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc')
Aug 15 02:03:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqvKuwTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:11 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 02:03:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.458s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] <== connect_volume: return (2973ms) {'type': 'block', 'scsi_wwn': '23732376237623962', 'path': '/dev/sdk'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732376237623962', 'path': '/dev/sdk'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.554s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lazy-loading 'flavor' on Instance uuid 03db2b8d-c678-4763-a87c-93e001ed9605 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8cdaa-95fa-458d-bc30-a574d2b98c2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:03:12 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:12 user nova-compute[73121]:   <source dev="/dev/sdk"/>
Aug 15 02:03:12 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:12 user nova-compute[73121]:   <serial>a9df1930-3ce3-443f-9b6d-e1128179b5cd</serial>
Aug 15 02:03:12 user nova-compute[73121]: </disk>
Aug 15 02:03:12 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6e1544-ca1a-4f57-be7d-cc0a18f3af8a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:12 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:12 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:12 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc78d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f0afce-8a6d-4a13-9f83-9356fa62e92e]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa70724d-2c64-4c57-a267-423ae5829160]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b61e51-793d-4726-b941-0525796e85c6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9619f9c-4684-4b70-8bc9-554273cfc09a]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed831212-51d3-44ab-90be-cba6fc279dfe]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[68698a53-59dd-456a-98f1-9633d33fb4cf]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260]
Aug 15 02:03:12 user nova-compute[73121]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:12 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7eae29-00cc-492c-a2ac-54642e404417]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] <== disconnect_volume: return (892ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Deleting instance files /opt/stack/data/nova/instances/77c8cd9b-475e-4293-9050-c1b2cd8ed015_del
Aug 15 02:03:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Deletion of /opt/stack/data/nova/instances/77c8cd9b-475e-4293-9050-c1b2cd8ed015_del complete
Aug 15 02:03:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] No VIF found with MAC fa:16:3e:70:8e:db, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:03:13 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 77c8cd9b-475e-4293-9050-c1b2cd8ed015 could not be found.
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqvKuwTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:13 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56bd115-80b2-4b1a-a993-63a01b88d447]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5683f02a-bf40-44cb-bd41-d69375472617 tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.237s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbecf52-8ea7-439c-9f11-208f4ae23f0f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:13 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:13 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:13 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc788550>, {}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Disconnecting from: [] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] <== disconnect_volume: return (72ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:13 user nova-compute[73121]: INFO nova.compute.manager [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Detaching volume a535e004-46f7-4d67-aa64-09e4c9a05700
Aug 15 02:03:13 user nova-compute[73121]: INFO nova.virt.block_device [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Attempting to driver detach volume a535e004-46f7-4d67-aa64-09e4c9a05700 from mountpoint /dev/vdb
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Attempting to detach device vdb from instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:13 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:13 user nova-compute[73121]:   <source dev="/dev/sdj"/>
Aug 15 02:03:13 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:13 user nova-compute[73121]:   <serial>a535e004-46f7-4d67-aa64-09e4c9a05700</serial>
Aug 15 02:03:13 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:03:13 user nova-compute[73121]: </disk>
Aug 15 02:03:13 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:13 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Successfully detached device vdb from instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 from the persistent domain config.
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:13 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:13 user nova-compute[73121]:   <source dev="/dev/sdj"/>
Aug 15 02:03:13 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:13 user nova-compute[73121]:   <serial>a535e004-46f7-4d67-aa64-09e4c9a05700</serial>
Aug 15 02:03:13 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:03:13 user nova-compute[73121]: </disk>
Aug 15 02:03:13 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-0404a40e-fbf4-464d-ba64-0567100efe1c req-03bbf3a6-5f06-4f88-80f2-d27175c92c4d service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0404a40e-fbf4-464d-ba64-0567100efe1c req-03bbf3a6-5f06-4f88-80f2-d27175c92c4d service nova] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0404a40e-fbf4-464d-ba64-0567100efe1c req-03bbf3a6-5f06-4f88-80f2-d27175c92c4d service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0404a40e-fbf4-464d-ba64-0567100efe1c req-03bbf3a6-5f06-4f88-80f2-d27175c92c4d service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-0404a40e-fbf4-464d-ba64-0567100efe1c req-03bbf3a6-5f06-4f88-80f2-d27175c92c4d service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] No waiting events found dispatching network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:13 user nova-compute[73121]: WARNING nova.compute.manager [req-0404a40e-fbf4-464d-ba64-0567100efe1c req-03bbf3a6-5f06-4f88-80f2-d27175c92c4d service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received unexpected event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 for instance with vm_state active and task_state rebuilding.
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692064993.9179006, 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:03:13 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Successfully detached device vdb from instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 from the live domain config.
Aug 15 02:03:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YsLvTkBp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:13 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cd6489-96f0-47e1-b4dc-56812eba98e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Preparing to wait for external event volume-reimaged-c84c4d82-7f25-4940-bf81-f97ec0247a32 {{(pid=73121) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdf901f-1646-4a50-a2d6-e68a4d8cfa53]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:14 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e20789870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700'): ({'sdj'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Removing single pathed devices sdj {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0abacf-e19b-43fa-a1c0-284cc3fd777e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38ba4d0-cf23-4a16-8bfc-ab1f5685809b]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Flushing IO for device /dev/sdj {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1add4fd0-b601-4476-817d-d763a6d9d469]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.059s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d717820e-80fd-453f-8be5-f1e588a9cc8d]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] SCSI volumes sdj have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16f8865-0db7-4636-938e-5de65b98a6c9]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace073c7-17e9-4bb8-8b7b-e2bdd30c5d0c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700, portal: 172.16.0.220,3260]
Aug 15 02:03:14 user nova-compute[73121]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a535e004-46f7-4d67-aa64-09e4c9a05700 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d67826e-4759-4687-899d-a72344f82f2a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] <== disconnect_volume: return (394ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.utils [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b1f2fe-ef0a-4116-a523-4f2dd87b6ee0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a306488-16d3-4664-9f18-8e12fff8037f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf22a38-b3c3-46c1-a885-e65b9a12a82c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[319645ff-b460-4847-a701-082b09fa2306]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:03:14 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc49d7f8-8a75-4e47-a575-ff086fa826c6]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG os_brick.utils [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: INFO nova.compute.manager [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Swapping volume a9df1930-3ce3-443f-9b6d-e1128179b5cd for 2fe420f7-a4ba-4f77-83af-361ef62bb2dd
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lazy-loading 'flavor' on Instance uuid 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e26dff8-c0d3-4916-b73e-b3f74897a96c tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.868s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:03:16 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:03:16 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:03:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=6966MB free_disk=25.645946502685547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 4e04a498-4518-46c9-bc49-4d0d5d6aa054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 793cddda-b586-4601-9f22-47938c9ccfb4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 66e5ded4-d25e-443f-b000-df3b693555dd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 03db2b8d-c678-4763-a87c-93e001ed9605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 77c8cd9b-475e-4293-9050-c1b2cd8ed015 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 3626675d-6ed7-400c-998f-67501a107da3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance b14c5889-916d-43cf-8faa-4373a5703c84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 8404c6b1-afcf-4362-a767-f3c18d50ebf0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.489s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:03:17 user nova-compute[73121]: INFO nova.compute.claims [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Claim successful on node user
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:03:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:03:18 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:03:18 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:03:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:03:18 user nova-compute[73121]: INFO nova.virt.block_device [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Booting with blank volume at /dev/vda
Aug 15 02:03:18 user nova-compute[73121]: DEBUG nova.policy [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d8ef0b0581e4a10b066c15119bafde1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea879c6a9d1f4d58998e077524a07225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:03:18 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Successfully created port: 739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692064984.3720822, d7d7ea92-e89a-43cb-8e41-b983fa788244 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:03:19 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] VM Stopped (Lifecycle Event)
Aug 15 02:03:19 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5366461b-c457-4622-a0bb-ed9d0a09b53b None None] [instance: d7d7ea92-e89a-43cb-8e41-b983fa788244] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Successfully updated port: 739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquired lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG nova.compute.manager [req-cd72bada-de85-4af5-baea-e6ec5216ab95 req-59cd469f-5c6c-4103-9a8d-886c830be2b1 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-changed-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG nova.compute.manager [req-cd72bada-de85-4af5-baea-e6ec5216ab95 req-59cd469f-5c6c-4103-9a8d-886c830be2b1 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Refreshing instance network info cache due to event network-changed-739b4e0a-f699-4550-8bf7-58935b4c9a18. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cd72bada-de85-4af5-baea-e6ec5216ab95 req-59cd469f-5c6c-4103-9a8d-886c830be2b1 service nova] Acquiring lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:03:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:03:20 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updating instance_info_cache with network_info: [{"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Releasing lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:03:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Instance network_info: |[{"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:03:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cd72bada-de85-4af5-baea-e6ec5216ab95 req-59cd469f-5c6c-4103-9a8d-886c830be2b1 service nova] Acquired lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:03:20 user nova-compute[73121]: DEBUG nova.network.neutron [req-cd72bada-de85-4af5-baea-e6ec5216ab95 req-59cd469f-5c6c-4103-9a8d-886c830be2b1 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Refreshing network info cache for port 739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:03:20 user nova-compute[73121]: DEBUG nova.network.neutron [req-cd72bada-de85-4af5-baea-e6ec5216ab95 req-59cd469f-5c6c-4103-9a8d-886c830be2b1 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updated VIF entry in instance network info cache for port 739b4e0a-f699-4550-8bf7-58935b4c9a18. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:03:20 user nova-compute[73121]: DEBUG nova.network.neutron [req-cd72bada-de85-4af5-baea-e6ec5216ab95 req-59cd469f-5c6c-4103-9a8d-886c830be2b1 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updating instance_info_cache with network_info: [{"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cd72bada-de85-4af5-baea-e6ec5216ab95 req-59cd469f-5c6c-4103-9a8d-886c830be2b1 service nova] Releasing lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:03:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG os_brick.utils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[85059d7c-b7fe-4013-8467-ce6231863fc6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e59230-9e33-4219-bdb9-f1d02727a6bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f3114-9c91-4e2c-bf84-be002f8a1351]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32e8aab-b5f3-4c3d-b436-3512c2b66f61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:03:23 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:03:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[138bc121-2a43-4495-a5d5-257d53103baa]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG os_brick.utils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:23 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updating existing volume attachment record: cb8438fa-6c99-4ed5-ab33-f863a0a4381b {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhDeLsaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03db2b8d-c678-4763-a87c-93e001ed9605', 'attached_at': '', 'detached_at': '', 'volume_id': '2fe420f7-a4ba-4f77-83af-361ef62bb2dd', 'serial': '2fe420f7-a4ba-4f77-83af-361ef62bb2dd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrwUTFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': '03db2b8d-c678-4763-a87c-93e001ed9605', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9df1930-3ce3-443f-9b6d-e1128179b5cd', 'serial'} {{(pid=73121) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhDeLsaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:25 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:25 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:25 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bffd5b6-fd8d-4711-bf4d-ccfdf8667270]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:03:25 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23c9795-59ee-4537-acc4-e38c7e3351a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd] added
Aug 15 02:03:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[893b8823-5fbd-4d27-aa4e-f5a3684433c6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4371ee69-16f6-4dfa-97cd-d430facc91da]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhDeLsaG {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhDeLsaG" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[72889085-f132-4d51-a3d7-c24a172ddcaa]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zhDeLsaG'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2705b43b-dc29-4a8d-93da-0eba3148d2d7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75da249-4fe6-48ab-abb6-c956ddc54b07]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[695bb2a8-fbd0-4d89-861c-8b7a8a586e1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd, portal: 172.16.0.220,3260]
Aug 15 02:03:25 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d872555-903e-42d0-a2ca-e4fed283fe95]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a1e0c9-e56e-4d11-a37f-e05410e26aa6]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:25 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] HCTL ('41', '-', '-', 0) found on session 17 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0428b97-19cb-4e5e-b52b-fdc5fff5731c]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Searching for a device in session 17 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:03:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhDeLsaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:03:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23030646436653936', 'path': '/dev/sdj'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030646436653936', 'path': '/dev/sdj'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:03:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lazy-loading 'flavor' on Instance uuid 03db2b8d-c678-4763-a87c-93e001ed9605 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:26 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692064991.887621, 77c8cd9b-475e-4293-9050-c1b2cd8ed015 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:03:26 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] VM Stopped (Lifecycle Event)
Aug 15 02:03:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5535ce3b-3655-4916-bddc-65052f567b92 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 91226112 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 183500800 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 344981504 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 506462208 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 672137216 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 761266176 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 869269504 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 901775360 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 994050048 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrwUTFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:32 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[089bea55-54af-4f0a-adbf-4a605bf072f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f22187-04ce-4dba-86a3-a7db4933a819]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:32 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:32 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:32 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e34cdd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd'): ({'sdk'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Removing single pathed devices sdk {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[891d514b-0b40-4d42-9da7-3384e2f5467e]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d55f2ca-7c2c-4d86-881c-91e173492e4c]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Flushing IO for device /dev/sdk {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c415bd-50ef-493a-9ce2-7ce0192b14a1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.045s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[205b571d-022d-4bae-9d8d-c960a0f55823]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Checking to see if SCSI volumes sdk have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] SCSI volumes sdk have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[31514817-1087-4779-afeb-4d91fb0f142b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c80a48-f22d-4d0d-9296-d099fed402fa]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260]
Aug 15 02:03:32 user nova-compute[73121]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:32 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb4d533-cb42-4b07-846f-2c08b127fc97]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] <== disconnect_volume: return (331ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhDeLsaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '03db2b8d-c678-4763-a87c-93e001ed9605', 'attached_at': '', 'detached_at': '', 'volume_id': '2fe420f7-a4ba-4f77-83af-361ef62bb2dd', 'serial'} {{(pid=73121) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 02:03:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] swap_volume: removing Cinder connection for volume a9df1930-3ce3-443f-9b6d-e1128179b5cd {{(pid=73121) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 02:03:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] swap_volume: Updating volume a9df1930-3ce3-443f-9b6d-e1128179b5cd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "zhDeLsaG", "auth_password": "5FZ3ElItHzRQvs", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "2fe420f7-a4ba-4f77-83af-361ef62bb2dd"}, "status": "reserved", "instance": "03db2b8d-c678-4763-a87c-93e001ed9605", "attached_at": "", "detached_at": "", "volume_id": "2fe420f7-a4ba-4f77-83af-361ef62bb2dd", "serial": "2fe420f7-a4ba-4f77-83af-361ef62bb2dd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2fe420f7-a4ba-4f77-83af-361ef62bb2dd', 'no_device': None, 'attachment_id': 'a771db58-050c-4cb2-9456-68f1bdfa9271'} {{(pid=73121) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 02:03:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3c4208b4-9da9-4a71-9475-9fa02c21a309 tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.004s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-769aa6d9-7d88-4def-b02d-a049d6d5e619 req-7ecf67dc-5961-4910-beb7-592c106154dc service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event volume-reimaged-c84c4d82-7f25-4940-bf81-f97ec0247a32 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-769aa6d9-7d88-4def-b02d-a049d6d5e619 req-7ecf67dc-5961-4910-beb7-592c106154dc service nova] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-769aa6d9-7d88-4def-b02d-a049d6d5e619 req-7ecf67dc-5961-4910-beb7-592c106154dc service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-769aa6d9-7d88-4def-b02d-a049d6d5e619 req-7ecf67dc-5961-4910-beb7-592c106154dc service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-769aa6d9-7d88-4def-b02d-a049d6d5e619 req-7ecf67dc-5961-4910-beb7-592c106154dc service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Processing event volume-reimaged-c84c4d82-7f25-4940-bf81-f97ec0247a32 {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance event wait completed in 19 seconds for volume-reimaged {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:03:34 user nova-compute[73121]: INFO nova.virt.block_device [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Booting with volume c84c4d82-7f25-4940-bf81-f97ec0247a32 at /dev/vda
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[236e073a-031b-43c3-bafc-8f07d5a59107]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[709e4bab-618a-464b-a34d-bc8235baef72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dca2b70-45bf-4682-a703-58f32869cd8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b768634-e024-4795-8cb4-f2ad7a572b77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:03:34 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc546eb-5d0c-4ab8-b785-7daa24daf61b]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Updating existing volume attachment record: 50b83174-687c-487a-b195-5967241a041d {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe373bf5-003e-49ff-a525-d1bc61f8040a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[598a4b64-1cdf-4c99-84f7-4cfe53a85e95]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c6f2f-5c39-42e4-a4cc-d6452edbef9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d8fb43-9dfe-4b5a-8536-d388ecf8b13c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:03:34 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fbc68e-ae17-4f36-964e-b2eb174b061d]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:34 user nova-compute[73121]: INFO nova.compute.manager [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Swapping volume 2fe420f7-a4ba-4f77-83af-361ef62bb2dd for a9df1930-3ce3-443f-9b6d-e1128179b5cd
Aug 15 02:03:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-d56fc316-9272-4591-bda5-570b79ec808f req-32ab0ba3-b5f1-460f-a251-5d8b600efe6f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-changed-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-d56fc316-9272-4591-bda5-570b79ec808f req-32ab0ba3-b5f1-460f-a251-5d8b600efe6f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing instance network info cache due to event network-changed-63b8a051-1128-4b55-bc00-de6e0375820f. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d56fc316-9272-4591-bda5-570b79ec808f req-32ab0ba3-b5f1-460f-a251-5d8b600efe6f service nova] Acquiring lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d56fc316-9272-4591-bda5-570b79ec808f req-32ab0ba3-b5f1-460f-a251-5d8b600efe6f service nova] Acquired lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:03:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-d56fc316-9272-4591-bda5-570b79ec808f req-32ab0ba3-b5f1-460f-a251-5d8b600efe6f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Refreshing network info cache for port 63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.network.neutron [req-d56fc316-9272-4591-bda5-570b79ec808f req-32ab0ba3-b5f1-460f-a251-5d8b600efe6f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updated VIF entry in instance network info cache for port 63b8a051-1128-4b55-bc00-de6e0375820f. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.network.neutron [req-d56fc316-9272-4591-bda5-570b79ec808f req-32ab0ba3-b5f1-460f-a251-5d8b600efe6f service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [{"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d56fc316-9272-4591-bda5-570b79ec808f req-32ab0ba3-b5f1-460f-a251-5d8b600efe6f service nova] Releasing lock "refresh_cache-3626675d-6ed7-400c-998f-67501a107da3" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:03:35 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Creating image(s)
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Ensure instance console log exists: /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Start _get_guest_xml network_info=[{"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'cb8438fa-6c99-4ed5-ab33-f863a0a4381b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoqgwLYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4ec1b1b-8080-462d-8403-a76daf4f42a0', 'serial': 'c4ec1b1b-8080-462d-8403-a76daf4f42a0'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:03:35 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:03:35 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoqgwLYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:35 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:35 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:35 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62b7e93-b436-4cef-9292-643d1d3e9893]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:03:35 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59e3711-c01f-43b4-8787-682a2d777e40]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0] added
Aug 15 02:03:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81cd1c1-085f-4f5b-8b97-c77fb66fad4f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eec90a-e359-4bc6-9d27-20ed11671d70]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoqgwLYh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoqgwLYh" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[874ded82-a0cb-4334-be06-e902a2a46fbb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoqgwLYh'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2275572b-cf35-41dd-947d-18419d2db882]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[027a709e-2e3a-4504-b6aa-0187714983cf]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[46008280-61ad-4c78-9a9f-3dd49a760fe7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0, portal: 172.16.0.220,3260]
Aug 15 02:03:35 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b63402-3d92-4ce2-8927-17117d09305e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b8646a-c30d-49c0-8564-7f9b10fbab49]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:35 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0df7b1-b1b6-441f-a675-b3e46277a220]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:35 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-5af05ec2-a8d2-4c41-8f49-aca952d3cb25 req-f5260467-b2f5-402b-984b-7a42974003f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-changed-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-5af05ec2-a8d2-4c41-8f49-aca952d3cb25 req-f5260467-b2f5-402b-984b-7a42974003f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing instance network info cache due to event network-changed-204821bd-61e9-471a-b225-84018c93b370. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5af05ec2-a8d2-4c41-8f49-aca952d3cb25 req-f5260467-b2f5-402b-984b-7a42974003f9 service nova] Acquiring lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5af05ec2-a8d2-4c41-8f49-aca952d3cb25 req-f5260467-b2f5-402b-984b-7a42974003f9 service nova] Acquired lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.network.neutron [req-5af05ec2-a8d2-4c41-8f49-aca952d3cb25 req-f5260467-b2f5-402b-984b-7a42974003f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Refreshing network info cache for port 204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.network.neutron [req-5af05ec2-a8d2-4c41-8f49-aca952d3cb25 req-f5260467-b2f5-402b-984b-7a42974003f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updated VIF entry in instance network info cache for port 204821bd-61e9-471a-b225-84018c93b370. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.network.neutron [req-5af05ec2-a8d2-4c41-8f49-aca952d3cb25 req-f5260467-b2f5-402b-984b-7a42974003f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [{"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5af05ec2-a8d2-4c41-8f49-aca952d3cb25 req-f5260467-b2f5-402b-984b-7a42974003f9 service nova] Releasing lock "refresh_cache-b14c5889-916d-43cf-8faa-4373a5703c84" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoqgwLYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23461663038333634', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461663038333634', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1758480341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1758480341',id=14,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-75oht42y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:03:18Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:62:1b,bridge_name='br-int',has_traffic_filtering=True,id=739b4e0a-f699-4550-8bf7-58935b4c9a18,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b4e0a-f6') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:36 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'pci_devices' on Instance uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:03:37 user nova-compute[73121]:   <uuid>f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845</uuid>
Aug 15 02:03:37 user nova-compute[73121]:   <name>instance-0000000e</name>
Aug 15 02:03:37 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:03:37 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:03:37 user nova-compute[73121]:   <metadata>
Aug 15 02:03:37 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:03:37 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:03:37 user nova-compute[73121]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1758480341</nova:name>
Aug 15 02:03:37 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:03:35</nova:creationTime>
Aug 15 02:03:37 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:03:37 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:03:37 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:03:37 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:03:37 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:03:37 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:03:37 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:03:37 user nova-compute[73121]:       <nova:owner>
Aug 15 02:03:37 user nova-compute[73121]:         <nova:user uuid="4d8ef0b0581e4a10b066c15119bafde1">tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member</nova:user>
Aug 15 02:03:37 user nova-compute[73121]:         <nova:project uuid="ea879c6a9d1f4d58998e077524a07225">tempest-ServerBootFromVolumeStableRescueTest-893410799</nova:project>
Aug 15 02:03:37 user nova-compute[73121]:       </nova:owner>
Aug 15 02:03:37 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:03:37 user nova-compute[73121]:       <nova:ports>
Aug 15 02:03:37 user nova-compute[73121]:         <nova:port uuid="739b4e0a-f699-4550-8bf7-58935b4c9a18">
Aug 15 02:03:37 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 02:03:37 user nova-compute[73121]:         </nova:port>
Aug 15 02:03:37 user nova-compute[73121]:       </nova:ports>
Aug 15 02:03:37 user nova-compute[73121]:     </nova:instance>
Aug 15 02:03:37 user nova-compute[73121]:   </metadata>
Aug 15 02:03:37 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:03:37 user nova-compute[73121]:     <system>
Aug 15 02:03:37 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:03:37 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:03:37 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:03:37 user nova-compute[73121]:       <entry name="serial">f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845</entry>
Aug 15 02:03:37 user nova-compute[73121]:       <entry name="uuid">f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845</entry>
Aug 15 02:03:37 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:03:37 user nova-compute[73121]:     </system>
Aug 15 02:03:37 user nova-compute[73121]:   </sysinfo>
Aug 15 02:03:37 user nova-compute[73121]:   <os>
Aug 15 02:03:37 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:03:37 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:03:37 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:03:37 user nova-compute[73121]:   </os>
Aug 15 02:03:37 user nova-compute[73121]:   <features>
Aug 15 02:03:37 user nova-compute[73121]:     <acpi/>
Aug 15 02:03:37 user nova-compute[73121]:     <apic/>
Aug 15 02:03:37 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:03:37 user nova-compute[73121]:   </features>
Aug 15 02:03:37 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:03:37 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:03:37 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:03:37 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:03:37 user nova-compute[73121]:   </clock>
Aug 15 02:03:37 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:03:37 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:03:37 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:03:37 user nova-compute[73121]:   </cpu>
Aug 15 02:03:37 user nova-compute[73121]:   <devices>
Aug 15 02:03:37 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:03:37 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:37 user nova-compute[73121]:       <source dev="/dev/sdb"/>
Aug 15 02:03:37 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:03:37 user nova-compute[73121]:       <serial>c4ec1b1b-8080-462d-8403-a76daf4f42a0</serial>
Aug 15 02:03:37 user nova-compute[73121]:     </disk>
Aug 15 02:03:37 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:03:37 user nova-compute[73121]:       <mac address="fa:16:3e:c8:62:1b"/>
Aug 15 02:03:37 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:03:37 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:03:37 user nova-compute[73121]:       <target dev="tap739b4e0a-f6"/>
Aug 15 02:03:37 user nova-compute[73121]:     </interface>
Aug 15 02:03:37 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:03:37 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/console.log" append="off"/>
Aug 15 02:03:37 user nova-compute[73121]:     </serial>
Aug 15 02:03:37 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:03:37 user nova-compute[73121]:     <video>
Aug 15 02:03:37 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:03:37 user nova-compute[73121]:     </video>
Aug 15 02:03:37 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:03:37 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:03:37 user nova-compute[73121]:     </rng>
Aug 15 02:03:37 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:03:37 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:03:37 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:03:37 user nova-compute[73121]:     </memballoon>
Aug 15 02:03:37 user nova-compute[73121]:   </devices>
Aug 15 02:03:37 user nova-compute[73121]: </domain>
Aug 15 02:03:37 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1758480341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1758480341',id=14,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-75oht42y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:03:18Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:62:1b,bridge_name='br-int',has_traffic_filtering=True,id=739b4e0a-f699-4550-8bf7-58935b4c9a18,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b4e0a-f6') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG os_vif [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:62:1b,bridge_name='br-int',has_traffic_filtering=True,id=739b4e0a-f699-4550-8bf7-58935b4c9a18,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b4e0a-f6') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap739b4e0a-f6, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap739b4e0a-f6, col_values=(('external_ids', {'iface-id': '739b4e0a-f699-4550-8bf7-58935b4c9a18', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:62:1b', 'vm-uuid': 'f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: INFO os_vif [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:62:1b,bridge_name='br-int',has_traffic_filtering=True,id=739b4e0a-f699-4550-8bf7-58935b4c9a18,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b4e0a-f6')
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No VIF found with MAC fa:16:3e:c8:62:1b, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "3626675d-6ed7-400c-998f-67501a107da3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:37 user nova-compute[73121]: INFO nova.compute.manager [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Terminating instance
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.compute.manager [req-6270932b-9bc5-4330-8f0b-a4a113765ead req-0343cc1b-1080-42a2-bfe0-52f31dd330b9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6270932b-9bc5-4330-8f0b-a4a113765ead req-0343cc1b-1080-42a2-bfe0-52f31dd330b9 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6270932b-9bc5-4330-8f0b-a4a113765ead req-0343cc1b-1080-42a2-bfe0-52f31dd330b9 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6270932b-9bc5-4330-8f0b-a4a113765ead req-0343cc1b-1080-42a2-bfe0-52f31dd330b9 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.compute.manager [req-6270932b-9bc5-4330-8f0b-a4a113765ead req-0343cc1b-1080-42a2-bfe0-52f31dd330b9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-unplugged-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG nova.compute.manager [req-6270932b-9bc5-4330-8f0b-a4a113765ead req-0343cc1b-1080-42a2-bfe0-52f31dd330b9 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-63b8a051-1128-4b55-bc00-de6e0375820f for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-bc7619d3-f85f-42b1-bd94-9af6507b9d53 req-2ff19038-a047-4959-87d8-18cb9c0ed796 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bc7619d3-f85f-42b1-bd94-9af6507b9d53 req-2ff19038-a047-4959-87d8-18cb9c0ed796 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bc7619d3-f85f-42b1-bd94-9af6507b9d53 req-2ff19038-a047-4959-87d8-18cb9c0ed796 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bc7619d3-f85f-42b1-bd94-9af6507b9d53 req-2ff19038-a047-4959-87d8-18cb9c0ed796 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-bc7619d3-f85f-42b1-bd94-9af6507b9d53 req-2ff19038-a047-4959-87d8-18cb9c0ed796 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-unplugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-bc7619d3-f85f-42b1-bd94-9af6507b9d53 req-2ff19038-a047-4959-87d8-18cb9c0ed796 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-unplugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:38 user nova-compute[73121]: WARNING nova.compute.manager [req-4ce307b2-0e94-4ba4-9a2f-01b7fe25fc36 req-632ee6e6-d56f-4a43-b75c-ff6b33e75e1e service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-f0f11527-ae15-42d4-98d6-74c2d031efe1 for instance with vm_state active and task_state deleting.
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "b14c5889-916d-43cf-8faa-4373a5703c84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:38 user nova-compute[73121]: INFO nova.compute.manager [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Terminating instance
Aug 15 02:03:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Instance destroyed successfully.
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lazy-loading 'resources' on Instance uuid 3626675d-6ed7-400c-998f-67501a107da3 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:2b:35,bridge_name='br-int',has_traffic_filtering=True,id=63b8a051-1128-4b55-bc00-de6e0375820f,network=Network(c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b8a051-11') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:2b:35,bridge_name='br-int',has_traffic_filtering=True,id=63b8a051-1128-4b55-bc00-de6e0375820f,network=Network(c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b8a051-11') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63b8a051-11, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: INFO os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:2b:35,bridge_name='br-int',has_traffic_filtering=True,id=63b8a051-1128-4b55-bc00-de6e0375820f,network=Network(c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63b8a051-11')
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:69,bridge_name='br-int',has_traffic_filtering=True,id=f0f11527-ae15-42d4-98d6-74c2d031efe1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0f11527-ae') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:69,bridge_name='br-int',has_traffic_filtering=True,id=f0f11527-ae15-42d4-98d6-74c2d031efe1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0f11527-ae') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0f11527-ae, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:39 user nova-compute[73121]: WARNING nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-63b8a051-1128-4b55-bc00-de6e0375820f for instance with vm_state active and task_state deleting.
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-unplugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:39 user nova-compute[73121]: WARNING nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-f2f84e08-dc37-4478-916a-8d3a90d8b298 for instance with vm_state active and task_state deleting.
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-unplugged-6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:39 user nova-compute[73121]: DEBUG nova.compute.manager [req-14db78dd-31f5-4251-90e8-899303f2b2f7 req-7ffeaf80-1c06-4345-9425-102beeb031c8 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-6f68bad0-3cde-4382-b499-61d134c3fbce for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: INFO os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:ce:69,bridge_name='br-int',has_traffic_filtering=True,id=f0f11527-ae15-42d4-98d6-74c2d031efe1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf0f11527-ae')
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:9c:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2f84e08-dc37-4478-916a-8d3a90d8b298,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2f84e08-dc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:9c:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2f84e08-dc37-4478-916a-8d3a90d8b298,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2f84e08-dc') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:40 user nova-compute[73121]: WARNING nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 for instance with vm_state active and task_state deleting.
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-unplugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:40 user nova-compute[73121]: WARNING nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 for instance with vm_state active and task_state deleting.
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:40 user nova-compute[73121]: WARNING nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state building and task_state spawning.
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:40 user nova-compute[73121]: WARNING nova.compute.manager [req-96d04688-47a5-4884-9c96-4abb3accb379 req-79a223da-2194-4564-80ab-41a6bf8628d7 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state building and task_state spawning.
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2f84e08-dc, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-unplugged-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-bddc610c-078b-4886-b60d-df61562e4852 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:40 user nova-compute[73121]: WARNING nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-bddc610c-078b-4886-b60d-df61562e4852 for instance with vm_state active and task_state deleting.
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-unplugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-unplugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-plugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Acquiring lock "3626675d-6ed7-400c-998f-67501a107da3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] Lock "3626675d-6ed7-400c-998f-67501a107da3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] No waiting events found dispatching network-vif-plugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:40 user nova-compute[73121]: WARNING nova.compute.manager [req-afa9e9e9-6f22-4fb6-9bfa-16d6af837051 req-bba4a80b-26e3-4aa1-8029-0bf1b27ffa87 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received unexpected event network-vif-plugged-6de97b6c-9106-49f3-b959-ef35cb48c6a1 for instance with vm_state active and task_state deleting.
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Instance destroyed successfully.
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.objects.instance [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lazy-loading 'resources' on Instance uuid b14c5889-916d-43cf-8faa-4373a5703c84 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: INFO os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:9c:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2f84e08-dc37-4478-916a-8d3a90d8b298,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf2f84e08-dc')
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "address": "fa:16:3e:c4:02:33", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6c3c5c-51", "ovs_interfaceid": "5e6c3c5c-51d2-4e94-9588-10dcd56ff249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c5c-51d2-4e94-9588-10dcd56ff249,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c5c-51') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c5c-51d2-4e94-9588-10dcd56ff249,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c5c-51') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=204821bd-61e9-471a-b225-84018c93b370,network=Network(3ed87f81-1036-4454-92c2-1f688c0d8676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204821bd-61') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=204821bd-61e9-471a-b225-84018c93b370,network=Network(3ed87f81-1036-4454-92c2-1f688c0d8676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204821bd-61') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e6c3c5c-51, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap204821bd-61, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:40 user nova-compute[73121]: INFO os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:02:33,bridge_name='br-int',has_traffic_filtering=True,id=5e6c3c5c-51d2-4e94-9588-10dcd56ff249,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6c3c5c-51')
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=6de97b6c-9106-49f3-b959-ef35cb48c6a1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de97b6c-91') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=6de97b6c-9106-49f3-b959-ef35cb48c6a1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de97b6c-91') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6de97b6c-91, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:39:d2,bridge_name='br-int',has_traffic_filtering=True,id=204821bd-61e9-471a-b225-84018c93b370,network=Network(3ed87f81-1036-4454-92c2-1f688c0d8676),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap204821bd-61')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:e7,bridge_name='br-int',has_traffic_filtering=True,id=c1a3db14-7ef4-4d41-8476-38b88f4e62c9,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a3db14-7e') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:e7,bridge_name='br-int',has_traffic_filtering=True,id=c1a3db14-7ef4-4d41-8476-38b88f4e62c9,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a3db14-7e') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1a3db14-7e, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:8f:96,bridge_name='br-int',has_traffic_filtering=True,id=6de97b6c-9106-49f3-b959-ef35cb48c6a1,network=Network(5dca0647-3a03-4800-a850-51d6d1197f89),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6de97b6c-91')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=bddc610c-078b-4886-b60d-df61562e4852,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddc610c-07') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=bddc610c-078b-4886-b60d-df61562e4852,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddc610c-07') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbddc610c-07, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:e7,bridge_name='br-int',has_traffic_filtering=True,id=c1a3db14-7ef4-4d41-8476-38b88f4e62c9,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc1a3db14-7e')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:58:50,bridge_name='br-int',has_traffic_filtering=True,id=6f68bad0-3cde-4382-b499-61d134c3fbce,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f68bad0-3c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:58:50,bridge_name='br-int',has_traffic_filtering=True,id=6f68bad0-3cde-4382-b499-61d134c3fbce,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f68bad0-3c') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6f68bad0-3c, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:0a:20,bridge_name='br-int',has_traffic_filtering=True,id=bddc610c-078b-4886-b60d-df61562e4852,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbddc610c-07')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1140277994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1140277994',id=11,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCjX0ITm9wHdvmH4VHzjZWC7igJb0B7jUgCQyAdfKKuilistIGvmZUhrCT+rdFUJHyQVEdN+9kyTeeYNix8j0zERJ6a4VYJh5xQFEf8gtjKWMVnjf+eoasdYDAC8MJL7A==',key_name='tempest-keypair-2056552815',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='14b2d4d29f2e48258adf11773b32df1e',ramdisk_id='',reservation_id='r-nu5rv468',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1839950291',owner_user_name='tempest-TaggedBootDevicesTest_v242-1839950291-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d2668ffb2e04520b8a4e582afa747a3',uuid=3626675d-6ed7-400c-998f-67501a107da3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converting VIF {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:85:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e3b9c4d-df3e-4d98-840d-9cc5d4124126,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3b9c4d-df') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:85:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e3b9c4d-df3e-4d98-840d-9cc5d4124126,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3b9c4d-df') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e3b9c4d-df, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:58:50,bridge_name='br-int',has_traffic_filtering=True,id=6f68bad0-3cde-4382-b499-61d134c3fbce,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6f68bad0-3c')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:79:28,bridge_name='br-int',has_traffic_filtering=True,id=e86be087-dc7e-4a04-b8f9-0dc60caa9bc0,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86be087-dc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:79:28,bridge_name='br-int',has_traffic_filtering=True,id=e86be087-dc7e-4a04-b8f9-0dc60caa9bc0,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86be087-dc') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape86be087-dc, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:85:8b,bridge_name='br-int',has_traffic_filtering=True,id=5e3b9c4d-df3e-4d98-840d-9cc5d4124126,network=Network(39c5d00f-5031-4796-987b-3df514458161),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e3b9c4d-df')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IlEOcVuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:41 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a381786-5140-416c-bdb8-a13a4c6db2fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:79:28,bridge_name='br-int',has_traffic_filtering=True,id=e86be087-dc7e-4a04-b8f9-0dc60caa9bc0,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86be087-dc')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=1785fd4a-8241-4c47-9f08-925c7fc16480,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1785fd4a-82') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=1785fd4a-8241-4c47-9f08-925c7fc16480,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1785fd4a-82') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1785fd4a-82, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd58af-6b70-471a-9189-35f986cb0830]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:41 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:41 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:41 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc78a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:88:d0,bridge_name='br-int',has_traffic_filtering=True,id=1785fd4a-8241-4c47-9f08-925c7fc16480,network=Network(3c0c9b83-71b5-44a1-8bf2-55a719e33f9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1785fd4a-82')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "address": "fa:16:3e:ef:a4:0d", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d9efae5-16", "ovs_interfaceid": "8d9efae5-16d3-48bb-b65b-fd44b2cebc26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a4:0d,bridge_name='br-int',has_traffic_filtering=True,id=8d9efae5-16d3-48bb-b65b-fd44b2cebc26,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9efae5-16') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a4:0d,bridge_name='br-int',has_traffic_filtering=True,id=8d9efae5-16d3-48bb-b65b-fd44b2cebc26,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9efae5-16') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d9efae5-16, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f468449-d649-4b23-9084-821e910a30d0]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:a4:0d,bridge_name='br-int',has_traffic_filtering=True,id=8d9efae5-16d3-48bb-b65b-fd44b2cebc26,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d9efae5-16')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:01:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-191343971',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-191343971',id=12,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGwKowb7nmwZSATtlQvU5ci3gY0DspKvUEXNNpfbzXQSPnELgQCYpoYjMzo3mCDKPmFU1CWgLQAnZ7wQPHSX6f0QqSYnc9kqoY0JPg6lNuDRvmkbyM2pf4sZejm7TGK8Q==',key_name='tempest-keypair-432037395',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf24913e47a44edfa2f7105cda66cefa',ramdisk_id='',reservation_id='r-p45ru047',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1162132718',owner_user_name='tempest-TaggedBootDevicesTest-1162132718-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='efee72a4c2b24e7fb19b58f6a26e173c',uuid=b14c5889-916d-43cf-8faa-4373a5703c84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converting VIF {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:af:4e,bridge_name='br-int',has_traffic_filtering=True,id=39cfe07e-3541-48b9-8b3e-4cbe3817bdc7,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39cfe07e-35') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:af:4e,bridge_name='br-int',has_traffic_filtering=True,id=39cfe07e-3541-48b9-8b3e-4cbe3817bdc7,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39cfe07e-35') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39cfe07e-35, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd82ee87-b497-4891-992e-4b41091798f6]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:41 user nova-compute[73121]: INFO os_vif [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:af:4e,bridge_name='br-int',has_traffic_filtering=True,id=39cfe07e-3541-48b9-8b3e-4cbe3817bdc7,network=Network(da0fcc87-daef-4764-8542-105479da410f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39cfe07e-35')
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GwugfiYc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:41 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eed21d8-6398-48f8-ac5f-0ca7a96ed488]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065021.8016748, f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:03:41 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] VM Resumed (Lifecycle Event)
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:41 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Instance spawned successfully.
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c20a70-a034-4a14-9656-1af807179b60]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:41 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065021.8067272, f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:03:41 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] VM Started (Lifecycle Event)
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-6f68bad0-3cde-4382-b499-61d134c3fbce {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:41 user nova-compute[73121]: WARNING nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-6f68bad0-3cde-4382-b499-61d134c3fbce for instance with vm_state active and task_state deleting.
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-unplugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:41 user nova-compute[73121]: WARNING nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-c1a3db14-7ef4-4d41-8476-38b88f4e62c9 for instance with vm_state active and task_state deleting.
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-unplugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:41 user nova-compute[73121]: WARNING nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 for instance with vm_state active and task_state deleting.
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-unplugged-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-1785fd4a-8241-4c47-9f08-925c7fc16480 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:41 user nova-compute[73121]: WARNING nova.compute.manager [req-0cb029d5-d6e6-4afd-b562-680189ed1d48 req-ffc380bc-f961-4235-93a2-3ccda79d12f9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-1785fd4a-8241-4c47-9f08-925c7fc16480 for instance with vm_state active and task_state deleting.
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ddd8fb-828e-4fc6-8bb2-b5d2a2280a23]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:41 user nova-compute[73121]: INFO nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Took 6.50 seconds to spawn the instance on the hypervisor.
Aug 15 02:03:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:41 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:42 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ec0195-d230-43f2-a81d-a30f09c8cb56]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf, portal: 172.16.0.220,3260]
Aug 15 02:03:42 user nova-compute[73121]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:42 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: INFO nova.compute.manager [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Took 24.57 seconds to build instance.
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5df5f3cb-2c90-4407-bec0-9075eb06b34f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.667s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffb80a37-c0f0-4bb7-aea7-f3b22a7b06cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c007ea-3e9e-4ddb-af48-3339a68a1a49]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.484s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] <== disconnect_volume: return (485ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.337s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vqCStXxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:42 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[398ef5e8-dfb0-455b-a382-f4fc9172d056]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2d37bf-0cfe-4301-a929-7195332a91d4]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:42 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:42 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e281c2ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be'): ({'sdd'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Removing single pathed devices sdd {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-unplugged-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-204821bd-61e9-471a-b225-84018c93b370 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:42 user nova-compute[73121]: WARNING nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-204821bd-61e9-471a-b225-84018c93b370 for instance with vm_state active and task_state deleting.
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-unplugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:42 user nova-compute[73121]: WARNING nova.compute.manager [req-1797e219-6e44-4df2-b1ca-e3c72f962f10 req-d74df316-a312-4123-b2a1-1d79086f848f service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 for instance with vm_state active and task_state deleting.
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[704dd4b1-ead1-4316-a415-aaa66b2a4b0c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[109c06c0-28e1-4f41-b78f-86c5079870fe]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Flushing IO for device /dev/sdd {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c4d964-fc11-4d4f-be17-13fee80163db]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d949c9-c1b9-4618-98dc-0e8454ba0e9d]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c7ab57-bfd4-497c-857a-f0912c1e08d6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[638d6436-eded-411d-bf90-26ab225e8104]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be, portal: 172.16.0.220,3260]
Aug 15 02:03:42 user nova-compute[73121]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:42 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60eafcfc-720b-4f84-820b-9f2d15c593be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf201ee4-343e-4d2b-8ff5-de07d93fb5a4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] <== disconnect_volume: return (702ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.353s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLlzyWfZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:42 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8417aee-fd12-458d-9ae8-4047fec15453]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d021a70-4ed3-4607-abb8-95f211061007]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:42 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:42 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc7f7b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2'): ({'sde'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Removing single pathed devices sde {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[68643a41-1f7b-4d5f-bbe1-ce409be20252]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[040da728-5c88-414a-b17a-6cc49b655146]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Flushing IO for device /dev/sde {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[922f104d-a201-4bf0-94da-a522d539380a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8980f1-454f-42b3-9770-3a16b050ff33]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bba055-bb32-46e7-838b-4dfb0c541747]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07972164-3f9e-4c20-a82e-de1bada3c30f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2, portal: 172.16.0.220,3260]
Aug 15 02:03:42 user nova-compute[73121]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:42 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2abc33a6-5dc9-45f9-937b-6022743a7ba2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7806e805-5796-4c7c-bc73-e81d2f8bdb58]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] <== disconnect_volume: return (678ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.322s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTldYufj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:42 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfc606e-cb7b-48c7-898d-b560a0b474ec]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[738a4504-06a5-49d2-a1a7-adae40d1e1ff]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:42 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:42 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:42 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e20798a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2'): ({'sdf'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Removing single pathed devices sdf {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[26947304-5416-4973-93d1-0f59604b4295]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec4347-8db5-421d-8897-86d110ffae16]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Flushing IO for device /dev/sdf {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1c159a-9f6c-4cbc-b864-cde8c12b19e9]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.047s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f36c83-15d2-42de-8c18-bb56c3f791db]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] SCSI volumes sdf have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ef5cd-aa1f-420f-a60c-3b2269922126]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[418d9f64-fb48-42c4-9042-c80443dc7795]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2, portal: 172.16.0.220,3260]
Aug 15 02:03:43 user nova-compute[73121]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56e32cd2-362c-4d9e-b710-91db0185f1c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce48236-1795-43b6-9a9d-d1818f6a057f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] <== disconnect_volume: return (635ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.311s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xfRrkYGq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:43 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b77f3b-31a2-4e18-997f-f4cde9646452]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cbee6b-76ae-4cc8-8299-07d3f442e357]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc78e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054'): ({'sdg'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Removing single pathed devices sdg {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad7bb5a-0add-4552-a496-196b2a21ba95]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[00967654-c8a6-4f6d-8a22-00e8d43e96e9]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Flushing IO for device /dev/sdg {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d930c90-8793-4197-879a-81d38bb8e192]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b1361a-dfab-4aac-b192-4653b84ed48f]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] SCSI volumes sdg have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080ad6f-8686-4de5-a659-9675d0d107a1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94d38fa-a643-4a03-bb2c-34b3ddab13c9]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054, portal: 172.16.0.220,3260]
Aug 15 02:03:43 user nova-compute[73121]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a0dad82-dc1b-48aa-86d3-f3d48c2c5054 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37167b8-f678-4b09-bf03-a53fc75cbe2a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] <== disconnect_volume: return (619ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Deleting instance files /opt/stack/data/nova/instances/3626675d-6ed7-400c-998f-67501a107da3_del
Aug 15 02:03:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Deletion of /opt/stack/data/nova/instances/3626675d-6ed7-400c-998f-67501a107da3_del complete
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.311s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7508dd1-01f2-4d80-99ab-1c523a30f098]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a93ddb9-fccd-4b33-9494-8d64d66fffe9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 (non-flash)
Aug 15 02:03:43 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc78cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1'): ({'sdh'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Removing single pathed devices sdh {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: INFO nova.compute.manager [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Took 6.22 seconds to destroy the instance on the hypervisor.
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 3626675d-6ed7-400c-998f-67501a107da3] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd41edc-c7f8-435d-9549-8d97e04c768b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdf8f06-fa00-44ad-86cf-02f4fddfdcff]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Flushing IO for device /dev/sdh {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[298b49fe-6009-4db7-a51c-89396b23fe03]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.038s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdf54fa-48d8-4f20-ae2f-60a305858413]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[481883aa-2eea-4874-884b-127e8fe8cab7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[82802ffd-745e-4580-ada8-ac3ce4b82f59]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1, portal: 172.16.0.220,3260]
Aug 15 02:03:43 user nova-compute[73121]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06278906-6755-4ee9-bb24-233af1e6e8b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5514d387-998e-4e5c-a9d1-f85c568367f3]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] <== disconnect_volume: return (618ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Deleting instance files /opt/stack/data/nova/instances/b14c5889-916d-43cf-8faa-4373a5703c84_del
Aug 15 02:03:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Deletion of /opt/stack/data/nova/instances/b14c5889-916d-43cf-8faa-4373a5703c84_del complete
Aug 15 02:03:43 user nova-compute[73121]: INFO nova.compute.manager [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Took 5.08 seconds to destroy the instance on the hypervisor.
Aug 15 02:03:43 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:03:43 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-unplugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-unplugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-plugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] Acquiring lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] Lock "b14c5889-916d-43cf-8faa-4373a5703c84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] No waiting events found dispatching network-vif-plugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:44 user nova-compute[73121]: WARNING nova.compute.manager [req-4deefc91-a3d9-4cd3-be61-25fb3b674d62 req-d73d8c4c-32e5-4d86-83ae-c77b09a648d9 service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received unexpected event network-vif-plugged-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 for instance with vm_state active and task_state deleting.
Aug 15 02:03:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-ab9f1d9b-667d-4466-8b7b-183e296b3e35 req-a1b5e603-df3f-4432-a492-8032ca62e9e3 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-deleted-5e6c3c5c-51d2-4e94-9588-10dcd56ff249 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:45 user nova-compute[73121]: INFO nova.compute.manager [req-ab9f1d9b-667d-4466-8b7b-183e296b3e35 req-a1b5e603-df3f-4432-a492-8032ca62e9e3 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Neutron deleted interface 5e6c3c5c-51d2-4e94-9588-10dcd56ff249; detaching it from the instance and deleting it from the info cache
Aug 15 02:03:45 user nova-compute[73121]: DEBUG nova.network.neutron [req-ab9f1d9b-667d-4466-8b7b-183e296b3e35 req-a1b5e603-df3f-4432-a492-8032ca62e9e3 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [{"id": "63b8a051-1128-4b55-bc00-de6e0375820f", "address": "fa:16:3e:90:2b:35", "network": {"id": "c6ae5ec6-a3e6-48b5-994f-a9cca2f444c1", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1797445762-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63b8a051-11", "ovs_interfaceid": "63b8a051-1128-4b55-bc00-de6e0375820f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "address": "fa:16:3e:98:ce:69", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f11527-ae", "ovs_interfaceid": "f0f11527-ae15-42d4-98d6-74c2d031efe1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "address": "fa:16:3e:24:9c:4b", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.146", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2f84e08-dc", "ovs_interfaceid": "f2f84e08-dc37-4478-916a-8d3a90d8b298", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "address": "fa:16:3e:fa:8f:96", "network": {"id": "5dca0647-3a03-4800-a850-51d6d1197f89", "bridge": "br-int", "label": "tempest-device-tagging-net1-54828257", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6de97b6c-91", "ovs_interfaceid": "6de97b6c-9106-49f3-b959-ef35cb48c6a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bddc610c-078b-4886-b60d-df61562e4852", "address": "fa:16:3e:1b:0a:20", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbddc610c-07", "ovs_interfaceid": "bddc610c-078b-4886-b60d-df61562e4852", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "address": "fa:16:3e:94:85:8b", "network": {"id": "39c5d00f-5031-4796-987b-3df514458161", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019603264", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "14b2d4d29f2e48258adf11773b32df1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e3b9c4d-df", "ovs_interfaceid": "5e3b9c4d-df3e-4d98-840d-9cc5d4124126", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-ab9f1d9b-667d-4466-8b7b-183e296b3e35 req-a1b5e603-df3f-4432-a492-8032ca62e9e3 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Detach interface failed, port_id=5e6c3c5c-51d2-4e94-9588-10dcd56ff249, reason: Instance 3626675d-6ed7-400c-998f-67501a107da3 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:03:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Creating image(s)
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Ensure instance console log exists: /opt/stack/data/nova/instances/77c8cd9b-475e-4293-9050-c1b2cd8ed015/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Start _get_guest_xml network_info=[{"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '50b83174-687c-487a-b195-5967241a041d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqvKuwTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '77c8cd9b-475e-4293-9050-c1b2cd8ed015', 'attached_at': '', 'detached_at': '', 'volume_id': 'c84c4d82-7f25-4940-bf81-f97ec0247a32', 'serial': 'c84c4d82-7f25-4940-bf81-f97ec0247a32'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:03:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 02:03:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.objects.instance [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 77c8cd9b-475e-4293-9050-c1b2cd8ed015 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqvKuwTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:46 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:46 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:46 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrwUTFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '03db2b8d-c678-4763-a87c-93e001ed9605', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9df1930-3ce3-443f-9b6d-e1128179b5cd', 'serial': 'a9df1930-3ce3-443f-9b6d-e1128179b5cd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhDeLsaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '2fe420f7-a4ba-4f77-83af-361ef62bb2dd'}, 'status': 'reserved', 'instance': '03db2b8d-c678-4763-a87c-93e001ed9605', 'attached_at': '', 'detached_at': '', 'volume_id': '2fe420f7-a4ba-4f77-83af-361ef62bb2dd', 'serial'} {{(pid=73121) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrwUTFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:46 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c90a4cf-31ef-4006-83ad-6326a0dc3693]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:03:46 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5daa8013-7418-4352-a06d-7367cc945641]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32] added
Aug 15 02:03:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e09ecf-29ed-415f-8c0b-6306adf01df0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7200d6-7465-4aaa-831e-98e14bbc009c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MqvKuwTm {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MqvKuwTm" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c740db-cee1-4fc0-96ae-85afb93b63ff]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MqvKuwTm'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c0202a-e04b-40da-8703-9c18ddd79bc3]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c190dc3-a8fc-4c78-863b-62162b97d827]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd793c17-80e9-401b-98bd-e95abcab7597]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260]
Aug 15 02:03:46 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a96843-1ddd-4345-a856-ea001d4b347d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[574d0946-762e-4927-98ea-c28034002ec5]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:46 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de5dfa-b043-48df-a0e4-f372d1057352]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:03:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqvKuwTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:47 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Took 3.74 seconds to deallocate network for instance.
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-1c9a1a52-1fe6-47d8-a72b-5ed2517534b0 req-9674fe99-1e07-480b-a38a-26971507f92d service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-deleted-8d9efae5-16d3-48bb-b65b-fd44b2cebc26 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:47 user nova-compute[73121]: INFO nova.compute.manager [req-1c9a1a52-1fe6-47d8-a72b-5ed2517534b0 req-9674fe99-1e07-480b-a38a-26971507f92d service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Neutron deleted interface 8d9efae5-16d3-48bb-b65b-fd44b2cebc26; detaching it from the instance and deleting it from the info cache
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-1c9a1a52-1fe6-47d8-a72b-5ed2517534b0 req-9674fe99-1e07-480b-a38a-26971507f92d service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [{"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1785fd4a-8241-4c47-9f08-925c7fc16480", "address": "fa:16:3e:87:88:d0", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1785fd4a-82", "ovs_interfaceid": "1785fd4a-8241-4c47-9f08-925c7fc16480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-1c9a1a52-1fe6-47d8-a72b-5ed2517534b0 req-9674fe99-1e07-480b-a38a-26971507f92d service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Detach interface failed, port_id=8d9efae5-16d3-48bb-b65b-fd44b2cebc26, reason: Instance b14c5889-916d-43cf-8faa-4373a5703c84 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d162a95-1c6a-4469-b3ba-2fcd3d4dc7e7 req-42c8dcbb-36eb-4d58-b13f-c6be1c8e7be6 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-deleted-6de97b6c-9106-49f3-b959-ef35cb48c6a1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d162a95-1c6a-4469-b3ba-2fcd3d4dc7e7 req-42c8dcbb-36eb-4d58-b13f-c6be1c8e7be6 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-deleted-bddc610c-078b-4886-b60d-df61562e4852 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d162a95-1c6a-4469-b3ba-2fcd3d4dc7e7 req-42c8dcbb-36eb-4d58-b13f-c6be1c8e7be6 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-deleted-5e3b9c4d-df3e-4d98-840d-9cc5d4124126 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d162a95-1c6a-4469-b3ba-2fcd3d4dc7e7 req-42c8dcbb-36eb-4d58-b13f-c6be1c8e7be6 service nova] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Received event network-vif-deleted-63b8a051-1128-4b55-bc00-de6e0375820f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23266343765613039', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266343765613039', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.314s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:47 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:47 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:03:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[804e54de-4677-4021-a943-75830c8b80e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:03:47 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1859624349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1099324202',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ8gEcMQAH0kKvlLTqDFoN126Q1iu/zZMIuFDLU7xxMwHV9ltLkgiaYzVdoyUTSZfNI34Auws52ZGHaGrri6N4rWPVwa87e5xkWI9k4aKald8BQ17zxIwAGqGM5Rgk/GA==',key_name='tempest-keypair-1468421416',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a213fca0e8144873a2a412a9348d4d20',ramdisk_id='',reservation_id='r-qzagwdto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-776954851',owner_user_name='tempest-ServerActionsV293TestJSON-776954851-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:03:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e0a6842bb14afda109782b1e26eaa9',uuid=77c8cd9b-475e-4293-9050-c1b2cd8ed015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converting VIF {"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:03:47 user nova-compute[73121]:   <uuid>77c8cd9b-475e-4293-9050-c1b2cd8ed015</uuid>
Aug 15 02:03:47 user nova-compute[73121]:   <name>instance-0000000a</name>
Aug 15 02:03:47 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:03:47 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:03:47 user nova-compute[73121]:   <metadata>
Aug 15 02:03:47 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:03:47 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:03:47 user nova-compute[73121]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1859624349</nova:name>
Aug 15 02:03:47 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:03:46</nova:creationTime>
Aug 15 02:03:47 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:03:47 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:03:47 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:03:47 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:03:47 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:03:47 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:03:47 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:03:47 user nova-compute[73121]:       <nova:owner>
Aug 15 02:03:47 user nova-compute[73121]:         <nova:user uuid="c4e0a6842bb14afda109782b1e26eaa9">tempest-ServerActionsV293TestJSON-776954851-project-member</nova:user>
Aug 15 02:03:47 user nova-compute[73121]:         <nova:project uuid="a213fca0e8144873a2a412a9348d4d20">tempest-ServerActionsV293TestJSON-776954851</nova:project>
Aug 15 02:03:47 user nova-compute[73121]:       </nova:owner>
Aug 15 02:03:47 user nova-compute[73121]:       <nova:ports>
Aug 15 02:03:47 user nova-compute[73121]:         <nova:port uuid="079356b3-bcfd-429d-a9bd-4f2c93cbf563">
Aug 15 02:03:47 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 02:03:47 user nova-compute[73121]:         </nova:port>
Aug 15 02:03:47 user nova-compute[73121]:       </nova:ports>
Aug 15 02:03:47 user nova-compute[73121]:     </nova:instance>
Aug 15 02:03:47 user nova-compute[73121]:   </metadata>
Aug 15 02:03:47 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:03:47 user nova-compute[73121]:     <system>
Aug 15 02:03:47 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:03:47 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:03:47 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:03:47 user nova-compute[73121]:       <entry name="serial">77c8cd9b-475e-4293-9050-c1b2cd8ed015</entry>
Aug 15 02:03:47 user nova-compute[73121]:       <entry name="uuid">77c8cd9b-475e-4293-9050-c1b2cd8ed015</entry>
Aug 15 02:03:47 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:03:47 user nova-compute[73121]:     </system>
Aug 15 02:03:47 user nova-compute[73121]:   </sysinfo>
Aug 15 02:03:47 user nova-compute[73121]:   <os>
Aug 15 02:03:47 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:03:47 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:03:47 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:03:47 user nova-compute[73121]:   </os>
Aug 15 02:03:47 user nova-compute[73121]:   <features>
Aug 15 02:03:47 user nova-compute[73121]:     <acpi/>
Aug 15 02:03:47 user nova-compute[73121]:     <apic/>
Aug 15 02:03:47 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:03:47 user nova-compute[73121]:   </features>
Aug 15 02:03:47 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:03:47 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:03:47 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:03:47 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:03:47 user nova-compute[73121]:   </clock>
Aug 15 02:03:47 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:03:47 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:03:47 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:03:47 user nova-compute[73121]:   </cpu>
Aug 15 02:03:47 user nova-compute[73121]:   <devices>
Aug 15 02:03:47 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:03:47 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:47 user nova-compute[73121]:       <source dev="/dev/sdc"/>
Aug 15 02:03:47 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:03:47 user nova-compute[73121]:       <serial>c84c4d82-7f25-4940-bf81-f97ec0247a32</serial>
Aug 15 02:03:47 user nova-compute[73121]:     </disk>
Aug 15 02:03:47 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:03:47 user nova-compute[73121]:       <mac address="fa:16:3e:04:9d:5b"/>
Aug 15 02:03:47 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:03:47 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:03:47 user nova-compute[73121]:       <target dev="tap079356b3-bc"/>
Aug 15 02:03:47 user nova-compute[73121]:     </interface>
Aug 15 02:03:47 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:03:47 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/77c8cd9b-475e-4293-9050-c1b2cd8ed015/console.log" append="off"/>
Aug 15 02:03:47 user nova-compute[73121]:     </serial>
Aug 15 02:03:47 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:03:47 user nova-compute[73121]:     <video>
Aug 15 02:03:47 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:03:47 user nova-compute[73121]:     </video>
Aug 15 02:03:47 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:03:47 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:03:47 user nova-compute[73121]:     </rng>
Aug 15 02:03:47 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:03:47 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:03:47 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:03:47 user nova-compute[73121]:     </memballoon>
Aug 15 02:03:47 user nova-compute[73121]:   </devices>
Aug 15 02:03:47 user nova-compute[73121]: </domain>
Aug 15 02:03:47 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1859624349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1099324202',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ8gEcMQAH0kKvlLTqDFoN126Q1iu/zZMIuFDLU7xxMwHV9ltLkgiaYzVdoyUTSZfNI34Auws52ZGHaGrri6N4rWPVwa87e5xkWI9k4aKald8BQ17zxIwAGqGM5Rgk/GA==',key_name='tempest-keypair-1468421416',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a213fca0e8144873a2a412a9348d4d20',ramdisk_id='',reservation_id='r-qzagwdto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-776954851',owner_user_name='tempest-ServerActionsV293TestJSON-776954851-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:03:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e0a6842bb14afda109782b1e26eaa9',uuid=77c8cd9b-475e-4293-9050-c1b2cd8ed015,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converting VIF {"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG os_vif [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap079356b3-bc, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap079356b3-bc, col_values=(('external_ids', {'iface-id': '079356b3-bcfd-429d-a9bd-4f2c93cbf563', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:9d:5b', 'vm-uuid': '77c8cd9b-475e-4293-9050-c1b2cd8ed015'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d01e93-eadf-4251-bfdc-96f8801e1091]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd] added
Aug 15 02:03:48 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:48 user nova-compute[73121]: INFO os_vif [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc')
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef631c-5e7e-4522-a1ae-1be767be3005]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f601e2f-54c3-469c-801f-a285d3bdd99e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYrwUTFX {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vYrwUTFX" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0660a864-4d09-43dc-8037-04de7607e850]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vYrwUTFX'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] No VIF found with MAC fa:16:3e:04:9d:5b, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c7f44e-6623-43ff-8624-06f6de928aea]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[515749e6-5c72-4960-a624-fd251423ff46]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:48 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:48 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[952b6943-cdaa-4a58-8eb3-c6be09285bb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260]
Aug 15 02:03:48 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:48 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7625f160-1e8d-4705-b4d8-b07a7b0d5127]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8d6b47-bfed-484e-ac61-33f2e33f865f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:48 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:48 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:48 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e41be75-1e80-495c-89e5-41f4d8b22613]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:03:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrwUTFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] <== connect_volume: return (2680ms) {'type': 'block', 'scsi_wwn': '23732376237623962', 'path': '/dev/sdd'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732376237623962', 'path': '/dev/sdd'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lazy-loading 'flavor' on Instance uuid 03db2b8d-c678-4763-a87c-93e001ed9605 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-deleted-1785fd4a-8241-4c47-9f08-925c7fc16480 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:49 user nova-compute[73121]: INFO nova.compute.manager [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Neutron deleted interface 1785fd4a-8241-4c47-9f08-925c7fc16480; detaching it from the instance and deleting it from the info cache
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [{"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "address": "fa:16:3e:ea:af:4e", "network": {"id": "da0fcc87-daef-4764-8542-105479da410f", "bridge": "br-int", "label": "tempest-device-tagging-net2-1531765545", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39cfe07e-35", "ovs_interfaceid": "39cfe07e-3541-48b9-8b3e-4cbe3817bdc7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Detach interface failed, port_id=1785fd4a-8241-4c47-9f08-925c7fc16480, reason: Instance b14c5889-916d-43cf-8faa-4373a5703c84 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-deleted-39cfe07e-3541-48b9-8b3e-4cbe3817bdc7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:49 user nova-compute[73121]: INFO nova.compute.manager [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Neutron deleted interface 39cfe07e-3541-48b9-8b3e-4cbe3817bdc7; detaching it from the instance and deleting it from the info cache
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [{"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "address": "fa:16:3e:2e:79:28", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.141", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86be087-dc", "ovs_interfaceid": "e86be087-dc7e-4a04-b8f9-0dc60caa9bc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Detach interface failed, port_id=39cfe07e-3541-48b9-8b3e-4cbe3817bdc7, reason: Instance b14c5889-916d-43cf-8faa-4373a5703c84 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-deleted-e86be087-dc7e-4a04-b8f9-0dc60caa9bc0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:49 user nova-compute[73121]: INFO nova.compute.manager [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Neutron deleted interface e86be087-dc7e-4a04-b8f9-0dc60caa9bc0; detaching it from the instance and deleting it from the info cache
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [{"id": "204821bd-61e9-471a-b225-84018c93b370", "address": "fa:16:3e:44:39:d2", "network": {"id": "3ed87f81-1036-4454-92c2-1f688c0d8676", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1531579997-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap204821bd-61", "ovs_interfaceid": "204821bd-61e9-471a-b225-84018c93b370", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "address": "fa:16:3e:71:c6:e7", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.101", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1a3db14-7e", "ovs_interfaceid": "c1a3db14-7ef4-4d41-8476-38b88f4e62c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6f68bad0-3cde-4382-b499-61d134c3fbce", "address": "fa:16:3e:90:58:50", "network": {"id": "3c0c9b83-71b5-44a1-8bf2-55a719e33f9c", "bridge": "br-int", "label": "tempest-device-tagging-net1-1934434968", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "bf24913e47a44edfa2f7105cda66cefa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6f68bad0-3c", "ovs_interfaceid": "6f68bad0-3cde-4382-b499-61d134c3fbce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:49 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Took 5.80 seconds to deallocate network for instance.
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-b7f37288-4680-44c8-bdad-c01bca0f5931 req-069e2c9b-8f11-4bd1-ac1f-8fb60ad9267c service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Detach interface failed, port_id=e86be087-dc7e-4a04-b8f9-0dc60caa9bc0, reason: Instance b14c5889-916d-43cf-8faa-4373a5703c84 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:03:49 user nova-compute[73121]: INFO nova.compute.manager [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Took 2.42 seconds to detach 3 volumes for instance.
Aug 15 02:03:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-9e6091f7-04c1-48b6-9c7e-97d74b8a5292 req-e1df6649-02f0-4297-b51a-933c88f1d769 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9e6091f7-04c1-48b6-9c7e-97d74b8a5292 req-e1df6649-02f0-4297-b51a-933c88f1d769 service nova] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9e6091f7-04c1-48b6-9c7e-97d74b8a5292 req-e1df6649-02f0-4297-b51a-933c88f1d769 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9e6091f7-04c1-48b6-9c7e-97d74b8a5292 req-e1df6649-02f0-4297-b51a-933c88f1d769 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-9e6091f7-04c1-48b6-9c7e-97d74b8a5292 req-e1df6649-02f0-4297-b51a-933c88f1d769 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] No waiting events found dispatching network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:49 user nova-compute[73121]: WARNING nova.compute.manager [req-9e6091f7-04c1-48b6-9c7e-97d74b8a5292 req-e1df6649-02f0-4297-b51a-933c88f1d769 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received unexpected event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 02:03:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:50 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:03:50 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:03:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:50 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Deleted allocations for instance 3626675d-6ed7-400c-998f-67501a107da3
Aug 15 02:03:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d424f827-12d3-4072-87ae-4dcd35ef85c4 tempest-TaggedBootDevicesTest_v242-1839950291 tempest-TaggedBootDevicesTest_v242-1839950291-project-member] Lock "3626675d-6ed7-400c-998f-67501a107da3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.242s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 126877696 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 265289728 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-76a5cf08-e3fc-47e7-8a8d-0461ae830d84 req-ba753790-4a0f-4a82-b032-545ef4b3ca6b service nova] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Received event network-vif-deleted-204821bd-61e9-471a-b225-84018c93b370 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 373293056 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-5f7582f3-4e84-4e00-b556-18cd5ea4bc0b req-f97a1ef5-466c-40ae-8cd9-9d957d7e06e7 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5f7582f3-4e84-4e00-b556-18cd5ea4bc0b req-f97a1ef5-466c-40ae-8cd9-9d957d7e06e7 service nova] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5f7582f3-4e84-4e00-b556-18cd5ea4bc0b req-f97a1ef5-466c-40ae-8cd9-9d957d7e06e7 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5f7582f3-4e84-4e00-b556-18cd5ea4bc0b req-f97a1ef5-466c-40ae-8cd9-9d957d7e06e7 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-5f7582f3-4e84-4e00-b556-18cd5ea4bc0b req-f97a1ef5-466c-40ae-8cd9-9d957d7e06e7 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] No waiting events found dispatching network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:51 user nova-compute[73121]: WARNING nova.compute.manager [req-5f7582f3-4e84-4e00-b556-18cd5ea4bc0b req-f97a1ef5-466c-40ae-8cd9-9d957d7e06e7 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received unexpected event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 02:03:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 505413632 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065032.257086, 77c8cd9b-475e-4293-9050-c1b2cd8ed015 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:03:52 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] VM Resumed (Lifecycle Event)
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:03:52 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance spawned successfully.
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:03:52 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065032.2616322, 77c8cd9b-475e-4293-9050-c1b2cd8ed015 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:03:52 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] VM Started (Lifecycle Event)
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:52 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 02:03:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.objects.instance [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73121) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-769aa6d9-7d88-4def-b02d-a049d6d5e619 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.070s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 597688320 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:52 user nova-compute[73121]: INFO nova.compute.manager [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Took 3.25 seconds to detach 3 volumes for instance.
Aug 15 02:03:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 749731840 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:53 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:03:53 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:03:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:53 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Deleted allocations for instance b14c5889-916d-43cf-8faa-4373a5703c84
Aug 15 02:03:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-61756ed7-e702-49c2-b4a0-a5f6e966f06b tempest-TaggedBootDevicesTest-1162132718 tempest-TaggedBootDevicesTest-1162132718-project-member] Lock "b14c5889-916d-43cf-8faa-4373a5703c84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.945s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 897581056 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 1063256064 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065019.4733868, 3626675d-6ed7-400c-998f-67501a107da3 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:03:54 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 3626675d-6ed7-400c-998f-67501a107da3] VM Stopped (Lifecycle Event)
Aug 15 02:03:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c97b4ed0-e795-4122-9f58-591a9c632174 None None] [instance: 3626675d-6ed7-400c-998f-67501a107da3] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhDeLsaG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '2fe420f7-a4ba-4f77-83af-361ef62bb2dd'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:54 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fcf111-5f47-414c-8091-085e093f0e9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.118s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a230e31b-1045-4cb1-b30e-2d2e2550b00b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:55 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:55 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:55 user nova-compute[73121]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:55 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:55 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd (non-flash)
Aug 15 02:03:55 user nova-compute[73121]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:55 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:55 user nova-compute[73121]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:55 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:55 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc78a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd'): ({'sdj'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Removing single pathed devices sdj {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d60a9e8-18c1-444e-a281-2cc9c7fe319a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef63a239-5919-4964-97b1-f02918a78bac]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Flushing IO for device /dev/sdj {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6deec0e8-0236-432f-8514-4842338365f7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.054s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8185de3c-a753-4fa9-98be-d60e4ba74b43]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] SCSI volumes sdj have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d40f4e9-a585-41ab-8f47-5a5ae10f2b1b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5c753b-bd67-4c9d-905f-aea724e30ca4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd, portal: 172.16.0.220,3260]
Aug 15 02:03:55 user nova-compute[73121]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:55 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe420f7-a4ba-4f77-83af-361ef62bb2dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c5033c-d0d2-4fd9-92a2-2a7002951a03]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.444s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] <== disconnect_volume: return (446ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrwUTFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '03db2b8d-c678-4763-a87c-93e001ed9605', 'attached_at': '', 'detached_at': '', 'volume_id': 'a9df1930-3ce3-443f-9b6d-e1128179b5cd', 'serial'} {{(pid=73121) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] swap_volume: removing Cinder connection for volume 2fe420f7-a4ba-4f77-83af-361ef62bb2dd {{(pid=73121) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 02:03:55 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065020.5449948, b14c5889-916d-43cf-8faa-4373a5703c84 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:03:55 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] VM Stopped (Lifecycle Event)
Aug 15 02:03:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3b4a4d92-af9a-4880-9f19-21bdbb240206 None None] [instance: b14c5889-916d-43cf-8faa-4373a5703c84] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:03:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] swap_volume: Updating volume 2fe420f7-a4ba-4f77-83af-361ef62bb2dd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "vYrwUTFX", "auth_password": "j2l8sH1mLTpcVF", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdd", "volume_id": "a9df1930-3ce3-443f-9b6d-e1128179b5cd"}, "status": "reserved", "instance": "03db2b8d-c678-4763-a87c-93e001ed9605", "attached_at": "", "detached_at": "", "volume_id": "a9df1930-3ce3-443f-9b6d-e1128179b5cd", "serial": "a9df1930-3ce3-443f-9b6d-e1128179b5cd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a9df1930-3ce3-443f-9b6d-e1128179b5cd', 'no_device': None, 'attachment_id': 'c308d28f-c3d9-44d9-bf2f-0808b7ef27ae'} {{(pid=73121) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 02:03:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9b939bfc-f2c1-4cba-8b2f-8ba6f99e67fd tempest-TestVolumeSwap-1001726479 tempest-TestVolumeSwap-1001726479-project-admin] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 22.683s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:57 user nova-compute[73121]: INFO nova.compute.manager [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Terminating instance
Aug 15 02:03:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-8868d82c-9298-4396-9801-5da6eb916e69 req-2dc8aa29-7273-4498-905c-a29276da35b4 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-unplugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8868d82c-9298-4396-9801-5da6eb916e69 req-2dc8aa29-7273-4498-905c-a29276da35b4 service nova] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8868d82c-9298-4396-9801-5da6eb916e69 req-2dc8aa29-7273-4498-905c-a29276da35b4 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8868d82c-9298-4396-9801-5da6eb916e69 req-2dc8aa29-7273-4498-905c-a29276da35b4 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-8868d82c-9298-4396-9801-5da6eb916e69 req-2dc8aa29-7273-4498-905c-a29276da35b4 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] No waiting events found dispatching network-vif-unplugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-8868d82c-9298-4396-9801-5da6eb916e69 req-2dc8aa29-7273-4498-905c-a29276da35b4 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-unplugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:57 user nova-compute[73121]: INFO nova.compute.manager [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Detaching volume a9df1930-3ce3-443f-9b6d-e1128179b5cd
Aug 15 02:03:57 user nova-compute[73121]: INFO nova.virt.block_device [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Attempting to driver detach volume a9df1930-3ce3-443f-9b6d-e1128179b5cd from mountpoint /dev/vdb
Aug 15 02:03:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Attempting to detach device vdb from instance 03db2b8d-c678-4763-a87c-93e001ed9605 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:57 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:57 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:03:57 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:57 user nova-compute[73121]:   <serial>a9df1930-3ce3-443f-9b6d-e1128179b5cd</serial>
Aug 15 02:03:57 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:03:57 user nova-compute[73121]: </disk>
Aug 15 02:03:57 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:57 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Successfully detached device vdb from instance 03db2b8d-c678-4763-a87c-93e001ed9605 from the persistent domain config.
Aug 15 02:03:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03db2b8d-c678-4763-a87c-93e001ed9605 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:03:57 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:03:57 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:03:57 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:03:57 user nova-compute[73121]:   <serial>a9df1930-3ce3-443f-9b6d-e1128179b5cd</serial>
Aug 15 02:03:57 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:03:57 user nova-compute[73121]: </disk>
Aug 15 02:03:57 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:03:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065038.450446, 03db2b8d-c678-4763-a87c-93e001ed9605 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03db2b8d-c678-4763-a87c-93e001ed9605 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:03:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Successfully detached device vdb from instance 03db2b8d-c678-4763-a87c-93e001ed9605 from the live domain config.
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vYrwUTFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'volume_id': 'a9df1930-3ce3-443f-9b6d-e1128179b5cd'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:03:58 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Instance destroyed successfully.
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lazy-loading 'resources' on Instance uuid 793cddda-b586-4601-9f22-47938c9ccfb4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T02:00:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1318082023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1318082023',id=6,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaNdyYz27xk+rfspm0CM27aYjNNYrCrxWXHlEOIfv3Q6WatZXVBNwBJYMUI8ec6jJvv3xvpG28G35Inoo6iygE/loMQdezawYx8ddyYXrAFA1EYbDFxyVvB9BTw1fLZcA==',key_name='tempest-keypair-479875827',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='728a7726790042c99e4bd53c2967ee96',ramdisk_id='',reservation_id='r-16w40iyx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2030671207',owner_user_name='tempest-TaggedAttachmentsTest-2030671207-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7967084f3b954a739fef6956a789cbad',uuid=793cddda-b586-4601-9f22-47938c9ccfb4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converting VIF {"id": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "address": "fa:16:3e:a4:6b:67", "network": {"id": "68649b4e-dcff-4f71-948e-9c2bf72d7b50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1774657577-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "728a7726790042c99e4bd53c2967ee96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c8be17e-32", "ovs_interfaceid": "1c8be17e-3242-49dd-b0b0-cd0834cf845c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:6b:67,bridge_name='br-int',has_traffic_filtering=True,id=1c8be17e-3242-49dd-b0b0-cd0834cf845c,network=Network(68649b4e-dcff-4f71-948e-9c2bf72d7b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8be17e-32') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_vif [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:6b:67,bridge_name='br-int',has_traffic_filtering=True,id=1c8be17e-3242-49dd-b0b0-cd0834cf845c,network=Network(68649b4e-dcff-4f71-948e-9c2bf72d7b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8be17e-32') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29bf01c-7d36-47fb-a8a5-bb32cbb03897]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c8be17e-32, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:03:58 user nova-compute[73121]: INFO os_vif [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:6b:67,bridge_name='br-int',has_traffic_filtering=True,id=1c8be17e-3242-49dd-b0b0-cd0834cf845c,network=Network(68649b4e-dcff-4f71-948e-9c2bf72d7b50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c8be17e-32')
Aug 15 02:03:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Deleting instance files /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4_del
Aug 15 02:03:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Deletion of /opt/stack/data/nova/instances/793cddda-b586-4601-9f22-47938c9ccfb4_del complete
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[668e62af-eac6-43bf-bb39-1053ec0e4f71]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:58 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:58 user nova-compute[73121]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:58 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:03:58 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:03:58 user nova-compute[73121]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd (non-flash)
Aug 15 02:03:58 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:03:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc6181f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd'): ({'sdd'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Removing single pathed devices sdd {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8121e04-d5f6-47af-931c-fe6c136839d6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[71de92b9-6675-4171-aa79-c756af9170fc]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Flushing IO for device /dev/sdd {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94bb658-af89-473e-b3d5-0a9149a5282c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:58 user nova-compute[73121]: INFO nova.compute.manager [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Took 1.47 seconds to destroy the instance on the hypervisor.
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d5ba22-fff3-4898-882b-ece750f033ff]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e023974-9d33-4f21-ab3a-dd7ceb8da279]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4b7129-aeb0-4377-bd79-64eed501d25b]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260]
Aug 15 02:03:58 user nova-compute[73121]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd, portal: 172.16.0.220,3260] successful.
Aug 15 02:03:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a9df1930-3ce3-443f-9b6d-e1128179b5cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8cad50-1d64-40e6-922c-eb4a67287d85]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] <== disconnect_volume: return (337ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:03:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:59 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Took 1.07 seconds to deallocate network for instance.
Aug 15 02:03:59 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lazy-loading 'flavor' on Instance uuid 03db2b8d-c678-4763-a87c-93e001ed9605 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-plugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] Acquiring lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] Lock "793cddda-b586-4601-9f22-47938c9ccfb4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] No waiting events found dispatching network-vif-plugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:03:59 user nova-compute[73121]: WARNING nova.compute.manager [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received unexpected event network-vif-plugged-1c8be17e-3242-49dd-b0b0-cd0834cf845c for instance with vm_state active and task_state deleting.
Aug 15 02:03:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Received event network-vif-deleted-1c8be17e-3242-49dd-b0b0-cd0834cf845c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:03:59 user nova-compute[73121]: INFO nova.compute.manager [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Neutron deleted interface 1c8be17e-3242-49dd-b0b0-cd0834cf845c; detaching it from the instance and deleting it from the info cache
Aug 15 02:03:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-f8ac5c88-2d1e-4248-b055-87fadfd54cde req-c592c98b-6ebe-4df7-a497-2ca6f0f76e71 service nova] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Detach interface failed, port_id=1c8be17e-3242-49dd-b0b0-cd0834cf845c, reason: Instance 793cddda-b586-4601-9f22-47938c9ccfb4 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a81f954e-5f7a-4625-8d2f-442807de722c tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.016s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:03:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:00 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Deleted allocations for instance 793cddda-b586-4601-9f22-47938c9ccfb4
Aug 15 02:04:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:00 user nova-compute[73121]: INFO nova.compute.manager [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Terminating instance
Aug 15 02:04:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3fcd2888-509c-467f-bb30-d5eb8204ee9c tempest-TaggedAttachmentsTest-2030671207 tempest-TaggedAttachmentsTest-2030671207-project-member] Lock "793cddda-b586-4601-9f22-47938c9ccfb4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.221s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:01 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Instance destroyed successfully.
Aug 15 02:04:01 user nova-compute[73121]: DEBUG nova.objects.instance [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lazy-loading 'resources' on Instance uuid 66e5ded4-d25e-443f-b000-df3b693555dd {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-714254737',display_name='tempest-VolumesAssistedSnapshotsTest-server-714254737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-714254737',id=8,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvqjDpFW1DYKIyoWcTWrUcH8jwnFbqX4Ou4e86sQMvrnmeBEw5GX+seawa5VuJJGBwx82NwTvi8jHtqhOxENpqNTnox7ce+/U58Hsd9vT3KVHoRkIM1tWlTBu+c8Lgn6w==',key_name='tempest-keypair-817842808',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8824b9c281ad4e97922c93bc3560f9f4',ramdisk_id='',reservation_id='r-94ggw7ri',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-313424460',owner_user_name='tempest-VolumesAssistedSnapshotsTest-313424460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='20c819edaf054b01b840814dcb08302a',uuid=66e5ded4-d25e-443f-b000-df3b693555dd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Converting VIF {"id": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "address": "fa:16:3e:09:04:81", "network": {"id": "d26d9068-15ea-4caa-9497-c02ca16530a1", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-813124633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8824b9c281ad4e97922c93bc3560f9f4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64ea77e9-d4", "ovs_interfaceid": "64ea77e9-d4fe-49e3-adae-2a4a0284b0c1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:04:81,bridge_name='br-int',has_traffic_filtering=True,id=64ea77e9-d4fe-49e3-adae-2a4a0284b0c1,network=Network(d26d9068-15ea-4caa-9497-c02ca16530a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ea77e9-d4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG os_vif [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:04:81,bridge_name='br-int',has_traffic_filtering=True,id=64ea77e9-d4fe-49e3-adae-2a4a0284b0c1,network=Network(d26d9068-15ea-4caa-9497-c02ca16530a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ea77e9-d4') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-4bffc56e-0da5-4b0e-985b-b7bc2e0a6008 req-18073011-cca6-4e6a-ae9f-cab749ca57aa service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received event network-vif-unplugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4bffc56e-0da5-4b0e-985b-b7bc2e0a6008 req-18073011-cca6-4e6a-ae9f-cab749ca57aa service nova] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4bffc56e-0da5-4b0e-985b-b7bc2e0a6008 req-18073011-cca6-4e6a-ae9f-cab749ca57aa service nova] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4bffc56e-0da5-4b0e-985b-b7bc2e0a6008 req-18073011-cca6-4e6a-ae9f-cab749ca57aa service nova] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-4bffc56e-0da5-4b0e-985b-b7bc2e0a6008 req-18073011-cca6-4e6a-ae9f-cab749ca57aa service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] No waiting events found dispatching network-vif-unplugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-4bffc56e-0da5-4b0e-985b-b7bc2e0a6008 req-18073011-cca6-4e6a-ae9f-cab749ca57aa service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received event network-vif-unplugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64ea77e9-d4, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:01 user nova-compute[73121]: INFO os_vif [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:04:81,bridge_name='br-int',has_traffic_filtering=True,id=64ea77e9-d4fe-49e3-adae-2a4a0284b0c1,network=Network(d26d9068-15ea-4caa-9497-c02ca16530a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64ea77e9-d4')
Aug 15 02:04:01 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Deleting instance files /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd_del
Aug 15 02:04:01 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Deletion of /opt/stack/data/nova/instances/66e5ded4-d25e-443f-b000-df3b693555dd_del complete
Aug 15 02:04:01 user nova-compute[73121]: INFO nova.compute.manager [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 02:04:01 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:04:01 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:04:02 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:04:02 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Took 0.97 seconds to deallocate network for instance.
Aug 15 02:04:02 user nova-compute[73121]: DEBUG nova.compute.manager [req-07e1ec7d-d4b9-47c1-b42c-d9c15fef1b1f req-0efb950b-e47d-47c7-8b77-e0352cec1e20 service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received event network-vif-deleted-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:02 user nova-compute[73121]: INFO nova.compute.manager [req-07e1ec7d-d4b9-47c1-b42c-d9c15fef1b1f req-0efb950b-e47d-47c7-8b77-e0352cec1e20 service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Neutron deleted interface 64ea77e9-d4fe-49e3-adae-2a4a0284b0c1; detaching it from the instance and deleting it from the info cache
Aug 15 02:04:02 user nova-compute[73121]: DEBUG nova.network.neutron [req-07e1ec7d-d4b9-47c1-b42c-d9c15fef1b1f req-0efb950b-e47d-47c7-8b77-e0352cec1e20 service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:04:02 user nova-compute[73121]: DEBUG nova.compute.manager [req-07e1ec7d-d4b9-47c1-b42c-d9c15fef1b1f req-0efb950b-e47d-47c7-8b77-e0352cec1e20 service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Detach interface failed, port_id=64ea77e9-d4fe-49e3-adae-2a4a0284b0c1, reason: Instance 66e5ded4-d25e-443f-b000-df3b693555dd could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:04:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:02 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:04:02 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:04:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:02 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Deleted allocations for instance 66e5ded4-d25e-443f-b000-df3b693555dd
Aug 15 02:04:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-35c566b1-8bbd-47f5-a2dc-00cb60862573 tempest-VolumesAssistedSnapshotsTest-313424460 tempest-VolumesAssistedSnapshotsTest-313424460-project-member] Lock "66e5ded4-d25e-443f-b000-df3b693555dd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.406s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-3cbaabe5-3652-4938-9543-b5802e51b237 req-f748969b-3fe1-41c2-8856-fd8e8b1e9e6b service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received event network-vif-plugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3cbaabe5-3652-4938-9543-b5802e51b237 req-f748969b-3fe1-41c2-8856-fd8e8b1e9e6b service nova] Acquiring lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3cbaabe5-3652-4938-9543-b5802e51b237 req-f748969b-3fe1-41c2-8856-fd8e8b1e9e6b service nova] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3cbaabe5-3652-4938-9543-b5802e51b237 req-f748969b-3fe1-41c2-8856-fd8e8b1e9e6b service nova] Lock "66e5ded4-d25e-443f-b000-df3b693555dd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-3cbaabe5-3652-4938-9543-b5802e51b237 req-f748969b-3fe1-41c2-8856-fd8e8b1e9e6b service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] No waiting events found dispatching network-vif-plugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:03 user nova-compute[73121]: WARNING nova.compute.manager [req-3cbaabe5-3652-4938-9543-b5802e51b237 req-f748969b-3fe1-41c2-8856-fd8e8b1e9e6b service nova] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Received unexpected event network-vif-plugged-64ea77e9-d4fe-49e3-adae-2a4a0284b0c1 for instance with vm_state deleted and task_state None.
Aug 15 02:04:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:04 user nova-compute[73121]: INFO nova.compute.manager [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Terminating instance
Aug 15 02:04:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-01e41f34-061f-4e5d-98cc-b83a74df59c3 req-9d2ca456-157c-47ff-80a1-a53840cc39bf service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received event network-vif-unplugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-01e41f34-061f-4e5d-98cc-b83a74df59c3 req-9d2ca456-157c-47ff-80a1-a53840cc39bf service nova] Acquiring lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-01e41f34-061f-4e5d-98cc-b83a74df59c3 req-9d2ca456-157c-47ff-80a1-a53840cc39bf service nova] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-01e41f34-061f-4e5d-98cc-b83a74df59c3 req-9d2ca456-157c-47ff-80a1-a53840cc39bf service nova] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-01e41f34-061f-4e5d-98cc-b83a74df59c3 req-9d2ca456-157c-47ff-80a1-a53840cc39bf service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] No waiting events found dispatching network-vif-unplugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-01e41f34-061f-4e5d-98cc-b83a74df59c3 req-9d2ca456-157c-47ff-80a1-a53840cc39bf service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received event network-vif-unplugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Instance destroyed successfully.
Aug 15 02:04:04 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lazy-loading 'resources' on Instance uuid 8404c6b1-afcf-4362-a767-f3c18d50ebf0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:02:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1566789889',display_name='tempest-ServersNegativeTestJSON-server-1566789889',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1566789889',id=13,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='104f505852da4e74b4afddadf5b4a9a5',ramdisk_id='',reservation_id='r-69hblso5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-68547960',owner_user_name='tempest-ServersNegativeTestJSON-68547960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:21Z,user_data=None,user_id='e4105e54b7264bb3aa05ceeccbf32277',uuid=8404c6b1-afcf-4362-a767-f3c18d50ebf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converting VIF {"id": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "address": "fa:16:3e:92:ea:aa", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f73b74c-f5", "ovs_interfaceid": "9f73b74c-f5fe-4bff-b97f-92219cd1e3a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=9f73b74c-f5fe-4bff-b97f-92219cd1e3a9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f73b74c-f5') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG os_vif [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=9f73b74c-f5fe-4bff-b97f-92219cd1e3a9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f73b74c-f5') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f73b74c-f5, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:05 user nova-compute[73121]: INFO os_vif [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:ea:aa,bridge_name='br-int',has_traffic_filtering=True,id=9f73b74c-f5fe-4bff-b97f-92219cd1e3a9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f73b74c-f5')
Aug 15 02:04:05 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Deleting instance files /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0_del
Aug 15 02:04:05 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Deletion of /opt/stack/data/nova/instances/8404c6b1-afcf-4362-a767-f3c18d50ebf0_del complete
Aug 15 02:04:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "6585e3eb-f7ab-429b-a000-59183bba993a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "6585e3eb-f7ab-429b-a000-59183bba993a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:05 user nova-compute[73121]: INFO nova.compute.manager [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 02:04:05 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:04:05 user nova-compute[73121]: INFO nova.compute.claims [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Claim successful on node user
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:04:05 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:04:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG nova.policy [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ae827293f6984ad78b5361b415b78a27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfd8c0c79b374093bfdd9fa70538769f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:04:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Creating image(s)
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "/opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "/opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "/opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.289s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.227s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk 1073741824" returned: 0 in 0.062s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.296s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-a35cbbcb-445f-44a7-af30-42b984c4b478 req-02daaafb-475a-4611-8c0d-da535e02c6e4 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received event network-vif-plugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a35cbbcb-445f-44a7-af30-42b984c4b478 req-02daaafb-475a-4611-8c0d-da535e02c6e4 service nova] Acquiring lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a35cbbcb-445f-44a7-af30-42b984c4b478 req-02daaafb-475a-4611-8c0d-da535e02c6e4 service nova] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a35cbbcb-445f-44a7-af30-42b984c4b478 req-02daaafb-475a-4611-8c0d-da535e02c6e4 service nova] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-a35cbbcb-445f-44a7-af30-42b984c4b478 req-02daaafb-475a-4611-8c0d-da535e02c6e4 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] No waiting events found dispatching network-vif-plugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:06 user nova-compute[73121]: WARNING nova.compute.manager [req-a35cbbcb-445f-44a7-af30-42b984c4b478 req-02daaafb-475a-4611-8c0d-da535e02c6e4 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received unexpected event network-vif-plugged-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 for instance with vm_state active and task_state deleting.
Aug 15 02:04:06 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:04:06 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Took 1.83 seconds to deallocate network for instance.
Aug 15 02:04:07 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Successfully created port: d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.254s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-ceaa3718-1f94-4443-add9-85a05a66cf57 req-c46daf3d-3b1d-456c-a8b0-2998a059c282 service nova] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Received event network-vif-deleted-9f73b74c-f5fe-4bff-b97f-92219cd1e3a9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Cannot resize image /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lazy-loading 'migration_context' on Instance uuid 6585e3eb-f7ab-429b-a000-59183bba993a {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Ensure instance console log exists: /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:07 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Deleted allocations for instance 8404c6b1-afcf-4362-a767-f3c18d50ebf0
Aug 15 02:04:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0faf527d-7e0b-4dc2-a666-d647ed4dc052 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "8404c6b1-afcf-4362-a767-f3c18d50ebf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.448s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Successfully updated port: d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "refresh_cache-6585e3eb-f7ab-429b-a000-59183bba993a" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquired lock "refresh_cache-6585e3eb-f7ab-429b-a000-59183bba993a" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-caed7c52-5c94-4d15-99fb-8e136984f72c req-af9ea515-f0e2-477b-af3e-4b16fe54eda8 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received event network-changed-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-caed7c52-5c94-4d15-99fb-8e136984f72c req-af9ea515-f0e2-477b-af3e-4b16fe54eda8 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Refreshing instance network info cache due to event network-changed-d9d060a8-9206-4e60-b670-9b287c7b825f. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-caed7c52-5c94-4d15-99fb-8e136984f72c req-af9ea515-f0e2-477b-af3e-4b16fe54eda8 service nova] Acquiring lock "refresh_cache-6585e3eb-f7ab-429b-a000-59183bba993a" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Updating instance_info_cache with network_info: [{"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Releasing lock "refresh_cache-6585e3eb-f7ab-429b-a000-59183bba993a" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Instance network_info: |[{"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-caed7c52-5c94-4d15-99fb-8e136984f72c req-af9ea515-f0e2-477b-af3e-4b16fe54eda8 service nova] Acquired lock "refresh_cache-6585e3eb-f7ab-429b-a000-59183bba993a" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-caed7c52-5c94-4d15-99fb-8e136984f72c req-af9ea515-f0e2-477b-af3e-4b16fe54eda8 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Refreshing network info cache for port d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Start _get_guest_xml network_info=[{"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:04:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:04:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1756626552',display_name='tempest-VolumesAdminNegativeTest-server-1756626552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1756626552',id=15,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfd8c0c79b374093bfdd9fa70538769f',ramdisk_id='',reservation_id='r-zwoa0i02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-465693716',owner_user_name='tempest-VolumesAdminNegativeTest-465693716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:04:06Z,user_data=None,user_id='ae827293f6984ad78b5361b415b78a27',uuid=6585e3eb-f7ab-429b-a000-59183bba993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converting VIF {"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:5e:b0,bridge_name='br-int',has_traffic_filtering=True,id=d9d060a8-9206-4e60-b670-9b287c7b825f,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d060a8-92') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lazy-loading 'pci_devices' on Instance uuid 6585e3eb-f7ab-429b-a000-59183bba993a {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:04:08 user nova-compute[73121]:   <uuid>6585e3eb-f7ab-429b-a000-59183bba993a</uuid>
Aug 15 02:04:08 user nova-compute[73121]:   <name>instance-0000000f</name>
Aug 15 02:04:08 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:04:08 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:04:08 user nova-compute[73121]:   <metadata>
Aug 15 02:04:08 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:04:08 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:04:08 user nova-compute[73121]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1756626552</nova:name>
Aug 15 02:04:08 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:04:08</nova:creationTime>
Aug 15 02:04:08 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:04:08 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:04:08 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:04:08 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:04:08 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:04:08 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:04:08 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:04:08 user nova-compute[73121]:       <nova:owner>
Aug 15 02:04:08 user nova-compute[73121]:         <nova:user uuid="ae827293f6984ad78b5361b415b78a27">tempest-VolumesAdminNegativeTest-465693716-project-member</nova:user>
Aug 15 02:04:08 user nova-compute[73121]:         <nova:project uuid="cfd8c0c79b374093bfdd9fa70538769f">tempest-VolumesAdminNegativeTest-465693716</nova:project>
Aug 15 02:04:08 user nova-compute[73121]:       </nova:owner>
Aug 15 02:04:08 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:04:08 user nova-compute[73121]:       <nova:ports>
Aug 15 02:04:08 user nova-compute[73121]:         <nova:port uuid="d9d060a8-9206-4e60-b670-9b287c7b825f">
Aug 15 02:04:08 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 02:04:08 user nova-compute[73121]:         </nova:port>
Aug 15 02:04:08 user nova-compute[73121]:       </nova:ports>
Aug 15 02:04:08 user nova-compute[73121]:     </nova:instance>
Aug 15 02:04:08 user nova-compute[73121]:   </metadata>
Aug 15 02:04:08 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:04:08 user nova-compute[73121]:     <system>
Aug 15 02:04:08 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:04:08 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:04:08 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:04:08 user nova-compute[73121]:       <entry name="serial">6585e3eb-f7ab-429b-a000-59183bba993a</entry>
Aug 15 02:04:08 user nova-compute[73121]:       <entry name="uuid">6585e3eb-f7ab-429b-a000-59183bba993a</entry>
Aug 15 02:04:08 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:04:08 user nova-compute[73121]:     </system>
Aug 15 02:04:08 user nova-compute[73121]:   </sysinfo>
Aug 15 02:04:08 user nova-compute[73121]:   <os>
Aug 15 02:04:08 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:04:08 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:04:08 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:04:08 user nova-compute[73121]:   </os>
Aug 15 02:04:08 user nova-compute[73121]:   <features>
Aug 15 02:04:08 user nova-compute[73121]:     <acpi/>
Aug 15 02:04:08 user nova-compute[73121]:     <apic/>
Aug 15 02:04:08 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:04:08 user nova-compute[73121]:   </features>
Aug 15 02:04:08 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:04:08 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:04:08 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:04:08 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:04:08 user nova-compute[73121]:   </clock>
Aug 15 02:04:08 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:04:08 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:04:08 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:04:08 user nova-compute[73121]:   </cpu>
Aug 15 02:04:08 user nova-compute[73121]:   <devices>
Aug 15 02:04:08 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:04:08 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:04:08 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk"/>
Aug 15 02:04:08 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:04:08 user nova-compute[73121]:     </disk>
Aug 15 02:04:08 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:04:08 user nova-compute[73121]:       <mac address="fa:16:3e:69:5e:b0"/>
Aug 15 02:04:08 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:04:08 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:04:08 user nova-compute[73121]:       <target dev="tapd9d060a8-92"/>
Aug 15 02:04:08 user nova-compute[73121]:     </interface>
Aug 15 02:04:08 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:04:08 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/console.log" append="off"/>
Aug 15 02:04:08 user nova-compute[73121]:     </serial>
Aug 15 02:04:08 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:04:08 user nova-compute[73121]:     <video>
Aug 15 02:04:08 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:04:08 user nova-compute[73121]:     </video>
Aug 15 02:04:08 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:04:08 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:04:08 user nova-compute[73121]:     </rng>
Aug 15 02:04:08 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:04:08 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:04:08 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:04:08 user nova-compute[73121]:     </memballoon>
Aug 15 02:04:08 user nova-compute[73121]:   </devices>
Aug 15 02:04:08 user nova-compute[73121]: </domain>
Aug 15 02:04:08 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1756626552',display_name='tempest-VolumesAdminNegativeTest-server-1756626552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1756626552',id=15,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cfd8c0c79b374093bfdd9fa70538769f',ramdisk_id='',reservation_id='r-zwoa0i02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-465693716',owner_user_name='tempest-VolumesAdminNegativeTest-465693716-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:04:06Z,user_data=None,user_id='ae827293f6984ad78b5361b415b78a27',uuid=6585e3eb-f7ab-429b-a000-59183bba993a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converting VIF {"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:5e:b0,bridge_name='br-int',has_traffic_filtering=True,id=d9d060a8-9206-4e60-b670-9b287c7b825f,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d060a8-92') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG os_vif [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:5e:b0,bridge_name='br-int',has_traffic_filtering=True,id=d9d060a8-9206-4e60-b670-9b287c7b825f,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d060a8-92') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9d060a8-92, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9d060a8-92, col_values=(('external_ids', {'iface-id': 'd9d060a8-9206-4e60-b670-9b287c7b825f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:5e:b0', 'vm-uuid': '6585e3eb-f7ab-429b-a000-59183bba993a'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:08 user nova-compute[73121]: INFO os_vif [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:5e:b0,bridge_name='br-int',has_traffic_filtering=True,id=d9d060a8-9206-4e60-b670-9b287c7b825f,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d060a8-92')
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:04:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] No VIF found with MAC fa:16:3e:69:5e:b0, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:04:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-caed7c52-5c94-4d15-99fb-8e136984f72c req-af9ea515-f0e2-477b-af3e-4b16fe54eda8 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Updated VIF entry in instance network info cache for port d9d060a8-9206-4e60-b670-9b287c7b825f. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:04:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-caed7c52-5c94-4d15-99fb-8e136984f72c req-af9ea515-f0e2-477b-af3e-4b16fe54eda8 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Updating instance_info_cache with network_info: [{"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:04:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-caed7c52-5c94-4d15-99fb-8e136984f72c req-af9ea515-f0e2-477b-af3e-4b16fe54eda8 service nova] Releasing lock "refresh_cache-6585e3eb-f7ab-429b-a000-59183bba993a" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG nova.compute.manager [req-1231ce6c-eff3-4dbd-b28c-b94b0747af61 req-b9d36725-fddc-4db1-889a-20aba72b38ba service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received event network-vif-plugged-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1231ce6c-eff3-4dbd-b28c-b94b0747af61 req-b9d36725-fddc-4db1-889a-20aba72b38ba service nova] Acquiring lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1231ce6c-eff3-4dbd-b28c-b94b0747af61 req-b9d36725-fddc-4db1-889a-20aba72b38ba service nova] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1231ce6c-eff3-4dbd-b28c-b94b0747af61 req-b9d36725-fddc-4db1-889a-20aba72b38ba service nova] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:10 user nova-compute[73121]: DEBUG nova.compute.manager [req-1231ce6c-eff3-4dbd-b28c-b94b0747af61 req-b9d36725-fddc-4db1-889a-20aba72b38ba service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] No waiting events found dispatching network-vif-plugged-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:10 user nova-compute[73121]: WARNING nova.compute.manager [req-1231ce6c-eff3-4dbd-b28c-b94b0747af61 req-b9d36725-fddc-4db1-889a-20aba72b38ba service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received unexpected event network-vif-plugged-d9d060a8-9206-4e60-b670-9b287c7b825f for instance with vm_state building and task_state spawning.
Aug 15 02:04:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:04:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:04:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:04:11 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:04:11 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Updating instance_info_cache with network_info: [{"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:04:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-1cd60a34-caf3-42b0-811d-ac93f5bc2e71" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:04:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065052.5537462, 6585e3eb-f7ab-429b-a000-59183bba993a => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:04:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] VM Resumed (Lifecycle Event)
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:04:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Instance spawned successfully.
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-7eb61218-7cc5-4d3b-a6c0-4a2474015746 req-0e6f512e-cb8c-4660-ad5e-83917fc56c24 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received event network-vif-plugged-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7eb61218-7cc5-4d3b-a6c0-4a2474015746 req-0e6f512e-cb8c-4660-ad5e-83917fc56c24 service nova] Acquiring lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7eb61218-7cc5-4d3b-a6c0-4a2474015746 req-0e6f512e-cb8c-4660-ad5e-83917fc56c24 service nova] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7eb61218-7cc5-4d3b-a6c0-4a2474015746 req-0e6f512e-cb8c-4660-ad5e-83917fc56c24 service nova] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-7eb61218-7cc5-4d3b-a6c0-4a2474015746 req-0e6f512e-cb8c-4660-ad5e-83917fc56c24 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] No waiting events found dispatching network-vif-plugged-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:12 user nova-compute[73121]: WARNING nova.compute.manager [req-7eb61218-7cc5-4d3b-a6c0-4a2474015746 req-0e6f512e-cb8c-4660-ad5e-83917fc56c24 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received unexpected event network-vif-plugged-d9d060a8-9206-4e60-b670-9b287c7b825f for instance with vm_state building and task_state spawning.
Aug 15 02:04:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065052.5551798, 6585e3eb-f7ab-429b-a000-59183bba993a => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:04:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] VM Started (Lifecycle Event)
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:04:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:04:12 user nova-compute[73121]: INFO nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 15 02:04:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:04:12 user nova-compute[73121]: INFO nova.compute.manager [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Took 7.57 seconds to build instance.
Aug 15 02:04:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e45d4f88-39df-4ac4-9f0f-f66708068a6e tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "6585e3eb-f7ab-429b-a000-59183bba993a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.685s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:13 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065038.4727218, 793cddda-b586-4601-9f22-47938c9ccfb4 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:04:13 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] VM Stopped (Lifecycle Event)
Aug 15 02:04:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-12568784-86c9-41f1-92ce-030bb44ec743 None None] [instance: 793cddda-b586-4601-9f22-47938c9ccfb4] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:04:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:16 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065041.1148825, 66e5ded4-d25e-443f-b000-df3b693555dd => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:04:16 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] VM Stopped (Lifecycle Event)
Aug 15 02:04:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-87db692e-3cc4-4a55-a496-8e9c576bbc69 None None] [instance: 66e5ded4-d25e-443f-b000-df3b693555dd] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:04:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:17 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:04:17 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7835MB free_disk=25.74660873413086GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 4e04a498-4518-46c9-bc49-4d0d5d6aa054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 03db2b8d-c678-4763-a87c-93e001ed9605 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 77c8cd9b-475e-4293-9050-c1b2cd8ed015 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6585e3eb-f7ab-429b-a000-59183bba993a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:04:17 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:04:18 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:04:18 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:04:18 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:04:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:19 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065044.983198, 8404c6b1-afcf-4362-a767-f3c18d50ebf0 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:04:19 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] VM Stopped (Lifecycle Event)
Aug 15 02:04:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a6ad1ea8-f1da-4df8-99c8-7c3eb0f5c709 None None] [instance: 8404c6b1-afcf-4362-a767-f3c18d50ebf0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:04:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:04:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:04:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquired lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:04:23 user nova-compute[73121]: DEBUG nova.network.neutron [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:04:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'info_cache' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.network.neutron [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating instance_info_cache with network_info: [{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Releasing lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:04:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance destroyed successfully.
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'resources' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-696601170',display_name='tempest-AttachVolumeTestJSON-server-696601170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-696601170',id=2,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrHjZP720UW0jo4iit8Pxgel5e+QfHyvMcWZQXiEzUPxi1x+UpLbvVaMujS5PIKUKWw85w6Ks98+VVNHxofUs5EqHpLoyaS82dHgB23+nlXLdzYmwP/5iI0jRjGfKXxQ==',key_name='tempest-keypair-65630828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-xc2jvcst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=2c215d73-ebab-4b74-b2a5-a4b5a0264e89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_vif [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap896acc02-dd, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:04:24 user nova-compute[73121]: INFO os_vif [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd')
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUjcPaqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:04:24 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d814c29d-354b-478b-8426-98ca3acebd94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd5f40e-3e34-4c56-8c23-b9ec560f25e6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:04:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:04:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc6185e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a'): ({'sdi'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Removing single pathed devices sdi {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de84f08-f3c8-459a-8708-4e872a66fb29]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0c65f5-a02d-41c6-9b50-9bb437233846]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flushing IO for device /dev/sdi {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e0f885-2aa2-4040-bc0b-043ed2ac0228]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.060s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[322c4bcd-ffa2-4046-a707-8b0c30712d33]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] SCSI volumes sdi have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f2bda6-9655-4b43-95c4-658813a2bc0f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34f60dc-7e16-4d0d-b4d0-b92acf4dfae3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260]
Aug 15 02:04:24 user nova-compute[73121]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260] successful.
Aug 15 02:04:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb984a3-4f3b-4887-a106-89e09c25daad]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== disconnect_volume: return (326ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Start _get_guest_xml network_info=[{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '80acfc14-e08f-4cba-80b3-cecac7224b94', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUjcPaqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '2c215d73-ebab-4b74-b2a5-a4b5a0264e89', 'attached_at': '', 'detached_at': '', 'volume_id': '77a6f9a6-c8fa-429d-9c83-c270ccb11f5a', 'serial': '77a6f9a6-c8fa-429d-9c83-c270ccb11f5a'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:24 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:04:24 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUjcPaqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:04:24 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:04:24 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:04:24 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[09031aae-c070-444d-836d-ba8472973c72]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:04:24 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd11dd67-d974-41bb-9045-6fae361dc6e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a] added
Aug 15 02:04:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ab0c94-9f34-4c95-b3b4-99f4d9b2755a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a368e8c-9fbc-4b27-9cdd-b09b25020bf4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUjcPaqL {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lUjcPaqL" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c415975-d6da-4790-8e9a-bd2886a24ccd]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lUjcPaqL'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a38c01d-dde5-4c56-af34-4ac37b812065]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c10fa64-11d9-4590-b24d-437f769ed751]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[718dd7d8-3d30-4e37-afe6-cc0dca89aa37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260]
Aug 15 02:04:24 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260] successful.
Aug 15 02:04:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b468699-ee56-4c2a-bdd7-265765496972]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[35375fbb-c54f-43d5-ab43-596ba483e776]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:04:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:04:24 user nova-compute[73121]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:04:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b0cf53-4556-4e00-a508-cb5290cee6fb]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:04:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUjcPaqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:04:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:04:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26632316239663535', 'path': '/dev/sdd'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:04:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632316239663535', 'path': '/dev/sdd'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:04:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-696601170',display_name='tempest-AttachVolumeTestJSON-server-696601170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-696601170',id=2,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrHjZP720UW0jo4iit8Pxgel5e+QfHyvMcWZQXiEzUPxi1x+UpLbvVaMujS5PIKUKWw85w6Ks98+VVNHxofUs5EqHpLoyaS82dHgB23+nlXLdzYmwP/5iI0jRjGfKXxQ==',key_name='tempest-keypair-65630828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-xc2jvcst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=2c215d73-ebab-4b74-b2a5-a4b5a0264e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:04:25 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:04:25 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:04:25 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:04:25 user nova-compute[73121]:   <uuid>2c215d73-ebab-4b74-b2a5-a4b5a0264e89</uuid>
Aug 15 02:04:25 user nova-compute[73121]:   <name>instance-00000002</name>
Aug 15 02:04:25 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:04:25 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:04:25 user nova-compute[73121]:   <metadata>
Aug 15 02:04:25 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:04:25 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:04:25 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeTestJSON-server-696601170</nova:name>
Aug 15 02:04:25 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:04:24</nova:creationTime>
Aug 15 02:04:25 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:04:25 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:04:25 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:04:25 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:04:25 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:04:25 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:04:25 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:04:25 user nova-compute[73121]:       <nova:owner>
Aug 15 02:04:25 user nova-compute[73121]:         <nova:user uuid="8c555808f8b84962b88920df9f029648">tempest-AttachVolumeTestJSON-1774938081-project-member</nova:user>
Aug 15 02:04:25 user nova-compute[73121]:         <nova:project uuid="16eb9362b3cd4011b8c7bae927a6edd6">tempest-AttachVolumeTestJSON-1774938081</nova:project>
Aug 15 02:04:25 user nova-compute[73121]:       </nova:owner>
Aug 15 02:04:25 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:04:25 user nova-compute[73121]:       <nova:ports>
Aug 15 02:04:25 user nova-compute[73121]:         <nova:port uuid="896acc02-dd7e-4464-be83-5a9774c03d22">
Aug 15 02:04:25 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 02:04:25 user nova-compute[73121]:         </nova:port>
Aug 15 02:04:25 user nova-compute[73121]:       </nova:ports>
Aug 15 02:04:25 user nova-compute[73121]:     </nova:instance>
Aug 15 02:04:25 user nova-compute[73121]:   </metadata>
Aug 15 02:04:25 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:04:25 user nova-compute[73121]:     <system>
Aug 15 02:04:25 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:04:25 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:04:25 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:04:25 user nova-compute[73121]:       <entry name="serial">2c215d73-ebab-4b74-b2a5-a4b5a0264e89</entry>
Aug 15 02:04:25 user nova-compute[73121]:       <entry name="uuid">2c215d73-ebab-4b74-b2a5-a4b5a0264e89</entry>
Aug 15 02:04:25 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:04:25 user nova-compute[73121]:     </system>
Aug 15 02:04:25 user nova-compute[73121]:   </sysinfo>
Aug 15 02:04:25 user nova-compute[73121]:   <os>
Aug 15 02:04:25 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:04:25 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:04:25 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:04:25 user nova-compute[73121]:   </os>
Aug 15 02:04:25 user nova-compute[73121]:   <features>
Aug 15 02:04:25 user nova-compute[73121]:     <acpi/>
Aug 15 02:04:25 user nova-compute[73121]:     <apic/>
Aug 15 02:04:25 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:04:25 user nova-compute[73121]:   </features>
Aug 15 02:04:25 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:04:25 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:04:25 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:04:25 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:04:25 user nova-compute[73121]:   </clock>
Aug 15 02:04:25 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:04:25 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:04:25 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:04:25 user nova-compute[73121]:   </cpu>
Aug 15 02:04:25 user nova-compute[73121]:   <devices>
Aug 15 02:04:25 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:04:25 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:04:25 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk"/>
Aug 15 02:04:25 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:04:25 user nova-compute[73121]:     </disk>
Aug 15 02:04:25 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:04:25 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:04:25 user nova-compute[73121]:       <source dev="/dev/sdd"/>
Aug 15 02:04:25 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:04:25 user nova-compute[73121]:       <serial>77a6f9a6-c8fa-429d-9c83-c270ccb11f5a</serial>
Aug 15 02:04:25 user nova-compute[73121]:     </disk>
Aug 15 02:04:25 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:04:25 user nova-compute[73121]:       <mac address="fa:16:3e:a5:cc:77"/>
Aug 15 02:04:25 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:04:25 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:04:25 user nova-compute[73121]:       <target dev="tap896acc02-dd"/>
Aug 15 02:04:25 user nova-compute[73121]:     </interface>
Aug 15 02:04:25 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:04:25 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/console.log" append="off"/>
Aug 15 02:04:25 user nova-compute[73121]:     </serial>
Aug 15 02:04:25 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:04:25 user nova-compute[73121]:     <video>
Aug 15 02:04:25 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:04:25 user nova-compute[73121]:     </video>
Aug 15 02:04:25 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:04:25 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:04:25 user nova-compute[73121]:     </rng>
Aug 15 02:04:25 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:04:25 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:04:25 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:04:25 user nova-compute[73121]:     </memballoon>
Aug 15 02:04:25 user nova-compute[73121]:   </devices>
Aug 15 02:04:25 user nova-compute[73121]: </domain>
Aug 15 02:04:25 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:04:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.246s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Cannot resize image /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'migration_context' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-696601170',display_name='tempest-AttachVolumeTestJSON-server-696601170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-696601170',id=2,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrHjZP720UW0jo4iit8Pxgel5e+QfHyvMcWZQXiEzUPxi1x+UpLbvVaMujS5PIKUKWw85w6Ks98+VVNHxofUs5EqHpLoyaS82dHgB23+nlXLdzYmwP/5iI0jRjGfKXxQ==',key_name='tempest-keypair-65630828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-xc2jvcst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:02:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=2c215d73-ebab-4b74-b2a5-a4b5a0264e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG os_vif [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap896acc02-dd, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap896acc02-dd, col_values=(('external_ids', {'iface-id': '896acc02-dd7e-4464-be83-5a9774c03d22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:cc:77', 'vm-uuid': '2c215d73-ebab-4b74-b2a5-a4b5a0264e89'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:04:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:26 user nova-compute[73121]: INFO os_vif [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd')
Aug 15 02:04:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-08302c28-f1dc-4528-81e0-1601ffaf0a34 req-99d86cef-33b4-4a99-a6c3-c2bf0c68197b service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-08302c28-f1dc-4528-81e0-1601ffaf0a34 req-99d86cef-33b4-4a99-a6c3-c2bf0c68197b service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-08302c28-f1dc-4528-81e0-1601ffaf0a34 req-99d86cef-33b4-4a99-a6c3-c2bf0c68197b service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-08302c28-f1dc-4528-81e0-1601ffaf0a34 req-99d86cef-33b4-4a99-a6c3-c2bf0c68197b service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-08302c28-f1dc-4528-81e0-1601ffaf0a34 req-99d86cef-33b4-4a99-a6c3-c2bf0c68197b service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:28 user nova-compute[73121]: WARNING nova.compute.manager [req-08302c28-f1dc-4528-81e0-1601ffaf0a34 req-99d86cef-33b4-4a99-a6c3-c2bf0c68197b service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state powering-on.
Aug 15 02:04:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-624707c8-9fce-4b2a-997b-5dd33629923c req-837c63f2-f788-4eb3-b8c9-2e9fef478aa1 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-624707c8-9fce-4b2a-997b-5dd33629923c req-837c63f2-f788-4eb3-b8c9-2e9fef478aa1 service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-624707c8-9fce-4b2a-997b-5dd33629923c req-837c63f2-f788-4eb3-b8c9-2e9fef478aa1 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-624707c8-9fce-4b2a-997b-5dd33629923c req-837c63f2-f788-4eb3-b8c9-2e9fef478aa1 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-624707c8-9fce-4b2a-997b-5dd33629923c req-837c63f2-f788-4eb3-b8c9-2e9fef478aa1 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:30 user nova-compute[73121]: WARNING nova.compute.manager [req-624707c8-9fce-4b2a-997b-5dd33629923c req-837c63f2-f788-4eb3-b8c9-2e9fef478aa1 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state powering-on.
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065070.6635942, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:04:30 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] VM Resumed (Lifecycle Event)
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:04:30 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance rebooted successfully.
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-04877681-7523-488a-a53f-dfdbbd93534e tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:04:30 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065070.6650324, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:04:30 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] VM Started (Lifecycle Event)
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:04:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:04:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:48 user nova-compute[73121]: INFO nova.compute.manager [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Terminating instance
Aug 15 02:04:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:04:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Instance destroyed successfully.
Aug 15 02:04:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lazy-loading 'resources' on Instance uuid 03db2b8d-c678-4763-a87c-93e001ed9605 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1075617605',display_name='tempest-TestVolumeSwap-server-1075617605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1075617605',id=9,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK6Df4J3+W6G8ZRIE24xz1PuwB5/59WhTgzvMGX2QBdprZnVd8yvdKUV9UOrKqQK8bIM9aE68MSeeMIFNlrfKObFpwJohc/sOtg58jfFWR3rjmH66qEXvQ8uCNcZe9zo3g==',key_name='tempest-keypair-1127225729',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d59eb976a212498c879959542db2def4',ramdisk_id='',reservation_id='r-evkma1pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1598085296',owner_user_name='tempest-TestVolumeSwap-1598085296-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e4474100b0c64d0bb6df27da43111622',uuid=03db2b8d-c678-4763-a87c-93e001ed9605,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Converting VIF {"id": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "address": "fa:16:3e:70:8e:db", "network": {"id": "1ad2e9c5-3b66-4f47-9fee-7b957599eb7f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1360247959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d59eb976a212498c879959542db2def4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dcc5fbd-ca", "ovs_interfaceid": "0dcc5fbd-cacb-44ff-8dd1-db427fa919af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:8e:db,bridge_name='br-int',has_traffic_filtering=True,id=0dcc5fbd-cacb-44ff-8dd1-db427fa919af,network=Network(1ad2e9c5-3b66-4f47-9fee-7b957599eb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcc5fbd-ca') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG os_vif [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:8e:db,bridge_name='br-int',has_traffic_filtering=True,id=0dcc5fbd-cacb-44ff-8dd1-db427fa919af,network=Network(1ad2e9c5-3b66-4f47-9fee-7b957599eb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcc5fbd-ca') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dcc5fbd-ca, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:04:49 user nova-compute[73121]: INFO os_vif [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:8e:db,bridge_name='br-int',has_traffic_filtering=True,id=0dcc5fbd-cacb-44ff-8dd1-db427fa919af,network=Network(1ad2e9c5-3b66-4f47-9fee-7b957599eb7f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dcc5fbd-ca')
Aug 15 02:04:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Deleting instance files /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605_del
Aug 15 02:04:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Deletion of /opt/stack/data/nova/instances/03db2b8d-c678-4763-a87c-93e001ed9605_del complete
Aug 15 02:04:49 user nova-compute[73121]: INFO nova.compute.manager [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 02:04:49 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:04:49 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:04:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cb2875b-3ad4-4c6e-9fa3-3ee7cd89021f req-878dc018-9367-49bc-bbea-f5be07e5bc7e service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received event network-vif-unplugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cb2875b-3ad4-4c6e-9fa3-3ee7cd89021f req-878dc018-9367-49bc-bbea-f5be07e5bc7e service nova] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cb2875b-3ad4-4c6e-9fa3-3ee7cd89021f req-878dc018-9367-49bc-bbea-f5be07e5bc7e service nova] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cb2875b-3ad4-4c6e-9fa3-3ee7cd89021f req-878dc018-9367-49bc-bbea-f5be07e5bc7e service nova] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cb2875b-3ad4-4c6e-9fa3-3ee7cd89021f req-878dc018-9367-49bc-bbea-f5be07e5bc7e service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] No waiting events found dispatching network-vif-unplugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cb2875b-3ad4-4c6e-9fa3-3ee7cd89021f req-878dc018-9367-49bc-bbea-f5be07e5bc7e service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received event network-vif-unplugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:04:51 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:04:51 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Took 2.42 seconds to deallocate network for instance.
Aug 15 02:04:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-e58f094d-b7cf-4152-a32e-96840be98955 req-c2cc4c9d-e574-451a-bc16-eb64796b8da4 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received event network-vif-deleted-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:51 user nova-compute[73121]: INFO nova.compute.manager [req-e58f094d-b7cf-4152-a32e-96840be98955 req-c2cc4c9d-e574-451a-bc16-eb64796b8da4 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Neutron deleted interface 0dcc5fbd-cacb-44ff-8dd1-db427fa919af; detaching it from the instance and deleting it from the info cache
Aug 15 02:04:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-e58f094d-b7cf-4152-a32e-96840be98955 req-c2cc4c9d-e574-451a-bc16-eb64796b8da4 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:04:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-e58f094d-b7cf-4152-a32e-96840be98955 req-c2cc4c9d-e574-451a-bc16-eb64796b8da4 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Detach interface failed, port_id=0dcc5fbd-cacb-44ff-8dd1-db427fa919af, reason: Instance 03db2b8d-c678-4763-a87c-93e001ed9605 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:04:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.414s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:52 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Deleted allocations for instance 03db2b8d-c678-4763-a87c-93e001ed9605
Aug 15 02:04:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2460ddaf-b11f-44d8-8815-131064a8d52e tempest-TestVolumeSwap-1598085296 tempest-TestVolumeSwap-1598085296-project-member] Lock "03db2b8d-c678-4763-a87c-93e001ed9605" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.022s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-e216c197-4975-497b-876d-c5b48eb3ea64 req-2c792707-c85b-4cda-9e38-2042018e2714 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received event network-vif-plugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e216c197-4975-497b-876d-c5b48eb3ea64 req-2c792707-c85b-4cda-9e38-2042018e2714 service nova] Acquiring lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e216c197-4975-497b-876d-c5b48eb3ea64 req-2c792707-c85b-4cda-9e38-2042018e2714 service nova] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e216c197-4975-497b-876d-c5b48eb3ea64 req-2c792707-c85b-4cda-9e38-2042018e2714 service nova] Lock "03db2b8d-c678-4763-a87c-93e001ed9605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-e216c197-4975-497b-876d-c5b48eb3ea64 req-2c792707-c85b-4cda-9e38-2042018e2714 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] No waiting events found dispatching network-vif-plugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:04:52 user nova-compute[73121]: WARNING nova.compute.manager [req-e216c197-4975-497b-876d-c5b48eb3ea64 req-2c792707-c85b-4cda-9e38-2042018e2714 service nova] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Received unexpected event network-vif-plugged-0dcc5fbd-cacb-44ff-8dd1-db427fa919af for instance with vm_state deleted and task_state None.
Aug 15 02:04:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:04:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:04:57 user nova-compute[73121]: INFO nova.compute.claims [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Claim successful on node user
Aug 15 02:04:57 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:04:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:04:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG nova.policy [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4c4cfb8a12443a4925a3f8d0814abd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65be7e8458ae4063b08bdf6cca18f36e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:04:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Creating image(s)
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "/opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "/opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.201s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk 1073741824" returned: 0 in 0.065s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.205s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Cannot resize image /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lazy-loading 'migration_context' on Instance uuid cf1d5cbe-cd2e-4a49-bde8-6e196b38994b {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Ensure instance console log exists: /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:04:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Successfully created port: 74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:05:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Successfully updated port: 74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "refresh_cache-cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquired lock "refresh_cache-cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-bb91f44d-efc7-4d2c-80fb-14f5c639c528 req-19a05d00-ec27-400b-9217-0a693e85fef6 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received event network-changed-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-bb91f44d-efc7-4d2c-80fb-14f5c639c528 req-19a05d00-ec27-400b-9217-0a693e85fef6 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Refreshing instance network info cache due to event network-changed-74de9087-2de4-4c14-bfb0-b7eca174aa8b. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bb91f44d-efc7-4d2c-80fb-14f5c639c528 req-19a05d00-ec27-400b-9217-0a693e85fef6 service nova] Acquiring lock "refresh_cache-cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Updating instance_info_cache with network_info: [{"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Releasing lock "refresh_cache-cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Instance network_info: |[{"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bb91f44d-efc7-4d2c-80fb-14f5c639c528 req-19a05d00-ec27-400b-9217-0a693e85fef6 service nova] Acquired lock "refresh_cache-cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.network.neutron [req-bb91f44d-efc7-4d2c-80fb-14f5c639c528 req-19a05d00-ec27-400b-9217-0a693e85fef6 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Refreshing network info cache for port 74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Start _get_guest_xml network_info=[{"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:05:01 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:01 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-291551951',display_name='tempest-VolumesActionsTest-instance-291551951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-291551951',id=16,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65be7e8458ae4063b08bdf6cca18f36e',ramdisk_id='',reservation_id='r-m2ab480k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-469015841',owner_user_name='tempest-VolumesActionsTest-469015841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:04:58Z,user_data=None,user_id='c4c4cfb8a12443a4925a3f8d0814abd8',uuid=cf1d5cbe-cd2e-4a49-bde8-6e196b38994b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converting VIF {"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:3b,bridge_name='br-int',has_traffic_filtering=True,id=74de9087-2de4-4c14-bfb0-b7eca174aa8b,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de9087-2d') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lazy-loading 'pci_devices' on Instance uuid cf1d5cbe-cd2e-4a49-bde8-6e196b38994b {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:05:01 user nova-compute[73121]:   <uuid>cf1d5cbe-cd2e-4a49-bde8-6e196b38994b</uuid>
Aug 15 02:05:01 user nova-compute[73121]:   <name>instance-00000010</name>
Aug 15 02:05:01 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:05:01 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:05:01 user nova-compute[73121]:   <metadata>
Aug 15 02:05:01 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:05:01 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:05:01 user nova-compute[73121]:       <nova:name>tempest-VolumesActionsTest-instance-291551951</nova:name>
Aug 15 02:05:01 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:05:01</nova:creationTime>
Aug 15 02:05:01 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:05:01 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:05:01 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:05:01 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:05:01 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:05:01 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:05:01 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:05:01 user nova-compute[73121]:       <nova:owner>
Aug 15 02:05:01 user nova-compute[73121]:         <nova:user uuid="c4c4cfb8a12443a4925a3f8d0814abd8">tempest-VolumesActionsTest-469015841-project-member</nova:user>
Aug 15 02:05:01 user nova-compute[73121]:         <nova:project uuid="65be7e8458ae4063b08bdf6cca18f36e">tempest-VolumesActionsTest-469015841</nova:project>
Aug 15 02:05:01 user nova-compute[73121]:       </nova:owner>
Aug 15 02:05:01 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:05:01 user nova-compute[73121]:       <nova:ports>
Aug 15 02:05:01 user nova-compute[73121]:         <nova:port uuid="74de9087-2de4-4c14-bfb0-b7eca174aa8b">
Aug 15 02:05:01 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 02:05:01 user nova-compute[73121]:         </nova:port>
Aug 15 02:05:01 user nova-compute[73121]:       </nova:ports>
Aug 15 02:05:01 user nova-compute[73121]:     </nova:instance>
Aug 15 02:05:01 user nova-compute[73121]:   </metadata>
Aug 15 02:05:01 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:05:01 user nova-compute[73121]:     <system>
Aug 15 02:05:01 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:05:01 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:05:01 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:05:01 user nova-compute[73121]:       <entry name="serial">cf1d5cbe-cd2e-4a49-bde8-6e196b38994b</entry>
Aug 15 02:05:01 user nova-compute[73121]:       <entry name="uuid">cf1d5cbe-cd2e-4a49-bde8-6e196b38994b</entry>
Aug 15 02:05:01 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:05:01 user nova-compute[73121]:     </system>
Aug 15 02:05:01 user nova-compute[73121]:   </sysinfo>
Aug 15 02:05:01 user nova-compute[73121]:   <os>
Aug 15 02:05:01 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:05:01 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:05:01 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:05:01 user nova-compute[73121]:   </os>
Aug 15 02:05:01 user nova-compute[73121]:   <features>
Aug 15 02:05:01 user nova-compute[73121]:     <acpi/>
Aug 15 02:05:01 user nova-compute[73121]:     <apic/>
Aug 15 02:05:01 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:05:01 user nova-compute[73121]:   </features>
Aug 15 02:05:01 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:05:01 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:05:01 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:05:01 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:05:01 user nova-compute[73121]:   </clock>
Aug 15 02:05:01 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:05:01 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:05:01 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:05:01 user nova-compute[73121]:   </cpu>
Aug 15 02:05:01 user nova-compute[73121]:   <devices>
Aug 15 02:05:01 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:05:01 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:05:01 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk"/>
Aug 15 02:05:01 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:05:01 user nova-compute[73121]:     </disk>
Aug 15 02:05:01 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:05:01 user nova-compute[73121]:       <mac address="fa:16:3e:4b:cb:3b"/>
Aug 15 02:05:01 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:01 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:05:01 user nova-compute[73121]:       <target dev="tap74de9087-2d"/>
Aug 15 02:05:01 user nova-compute[73121]:     </interface>
Aug 15 02:05:01 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:05:01 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/console.log" append="off"/>
Aug 15 02:05:01 user nova-compute[73121]:     </serial>
Aug 15 02:05:01 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:05:01 user nova-compute[73121]:     <video>
Aug 15 02:05:01 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:01 user nova-compute[73121]:     </video>
Aug 15 02:05:01 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:05:01 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:05:01 user nova-compute[73121]:     </rng>
Aug 15 02:05:01 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:05:01 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:05:01 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:05:01 user nova-compute[73121]:     </memballoon>
Aug 15 02:05:01 user nova-compute[73121]:   </devices>
Aug 15 02:05:01 user nova-compute[73121]: </domain>
Aug 15 02:05:01 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-291551951',display_name='tempest-VolumesActionsTest-instance-291551951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-291551951',id=16,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65be7e8458ae4063b08bdf6cca18f36e',ramdisk_id='',reservation_id='r-m2ab480k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-469015841',owner_user_name='tempest-VolumesActionsTest-469015841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:04:58Z,user_data=None,user_id='c4c4cfb8a12443a4925a3f8d0814abd8',uuid=cf1d5cbe-cd2e-4a49-bde8-6e196b38994b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converting VIF {"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:3b,bridge_name='br-int',has_traffic_filtering=True,id=74de9087-2de4-4c14-bfb0-b7eca174aa8b,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de9087-2d') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG os_vif [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:3b,bridge_name='br-int',has_traffic_filtering=True,id=74de9087-2de4-4c14-bfb0-b7eca174aa8b,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de9087-2d') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74de9087-2d, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74de9087-2d, col_values=(('external_ids', {'iface-id': '74de9087-2de4-4c14-bfb0-b7eca174aa8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:cb:3b', 'vm-uuid': 'cf1d5cbe-cd2e-4a49-bde8-6e196b38994b'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:05:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:01 user nova-compute[73121]: INFO os_vif [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:3b,bridge_name='br-int',has_traffic_filtering=True,id=74de9087-2de4-4c14-bfb0-b7eca174aa8b,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de9087-2d')
Aug 15 02:05:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] No VIF found with MAC fa:16:3e:4b:cb:3b, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:02 user nova-compute[73121]: INFO nova.compute.manager [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Terminating instance
Aug 15 02:05:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG nova.network.neutron [req-bb91f44d-efc7-4d2c-80fb-14f5c639c528 req-19a05d00-ec27-400b-9217-0a693e85fef6 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Updated VIF entry in instance network info cache for port 74de9087-2de4-4c14-bfb0-b7eca174aa8b. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG nova.network.neutron [req-bb91f44d-efc7-4d2c-80fb-14f5c639c528 req-19a05d00-ec27-400b-9217-0a693e85fef6 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Updating instance_info_cache with network_info: [{"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bb91f44d-efc7-4d2c-80fb-14f5c639c528 req-19a05d00-ec27-400b-9217-0a693e85fef6 service nova] Releasing lock "refresh_cache-cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-085f294a-fdd8-43aa-82b9-a5c272177d72 req-5f4f2c31-daae-41e0-b63f-124523a9220b service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-unplugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-085f294a-fdd8-43aa-82b9-a5c272177d72 req-5f4f2c31-daae-41e0-b63f-124523a9220b service nova] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-085f294a-fdd8-43aa-82b9-a5c272177d72 req-5f4f2c31-daae-41e0-b63f-124523a9220b service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-085f294a-fdd8-43aa-82b9-a5c272177d72 req-5f4f2c31-daae-41e0-b63f-124523a9220b service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-085f294a-fdd8-43aa-82b9-a5c272177d72 req-5f4f2c31-daae-41e0-b63f-124523a9220b service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] No waiting events found dispatching network-vif-unplugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-085f294a-fdd8-43aa-82b9-a5c272177d72 req-5f4f2c31-daae-41e0-b63f-124523a9220b service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-unplugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-d7068040-f0ec-4275-b4f5-8bf5de21d2da req-f72f08c3-ea03-430e-965d-5900bd36152e service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received event network-vif-plugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d7068040-f0ec-4275-b4f5-8bf5de21d2da req-f72f08c3-ea03-430e-965d-5900bd36152e service nova] Acquiring lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d7068040-f0ec-4275-b4f5-8bf5de21d2da req-f72f08c3-ea03-430e-965d-5900bd36152e service nova] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d7068040-f0ec-4275-b4f5-8bf5de21d2da req-f72f08c3-ea03-430e-965d-5900bd36152e service nova] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-d7068040-f0ec-4275-b4f5-8bf5de21d2da req-f72f08c3-ea03-430e-965d-5900bd36152e service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] No waiting events found dispatching network-vif-plugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:03 user nova-compute[73121]: WARNING nova.compute.manager [req-d7068040-f0ec-4275-b4f5-8bf5de21d2da req-f72f08c3-ea03-430e-965d-5900bd36152e service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received unexpected event network-vif-plugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b for instance with vm_state building and task_state spawning.
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065089.0862927, 03db2b8d-c678-4763-a87c-93e001ed9605 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:04 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] VM Stopped (Lifecycle Event)
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9ae07bb8-be52-47f5-bdd3-811b9de97951 None None] [instance: 03db2b8d-c678-4763-a87c-93e001ed9605] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Instance destroyed successfully.
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lazy-loading 'resources' on Instance uuid 77c8cd9b-475e-4293-9050-c1b2cd8ed015 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:01:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1859624349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1099324202',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZ8gEcMQAH0kKvlLTqDFoN126Q1iu/zZMIuFDLU7xxMwHV9ltLkgiaYzVdoyUTSZfNI34Auws52ZGHaGrri6N4rWPVwa87e5xkWI9k4aKald8BQ17zxIwAGqGM5Rgk/GA==',key_name='tempest-keypair-1468421416',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:03:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a213fca0e8144873a2a412a9348d4d20',ramdisk_id='',reservation_id='r-qzagwdto',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-776954851',owner_user_name='tempest-ServerActionsV293TestJSON-776954851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:03:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4e0a6842bb14afda109782b1e26eaa9',uuid=77c8cd9b-475e-4293-9050-c1b2cd8ed015,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converting VIF {"id": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "address": "fa:16:3e:04:9d:5b", "network": {"id": "63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-355974723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a213fca0e8144873a2a412a9348d4d20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap079356b3-bc", "ovs_interfaceid": "079356b3-bcfd-429d-a9bd-4f2c93cbf563", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_vif [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap079356b3-bc, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:05:04 user nova-compute[73121]: INFO os_vif [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:9d:5b,bridge_name='br-int',has_traffic_filtering=True,id=079356b3-bcfd-429d-a9bd-4f2c93cbf563,network=Network(63d6d2cf-0ed7-4c7b-a89d-d1e3261d863c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap079356b3-bc')
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MqvKuwTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:05:04 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c084bc61-3e4f-447c-a09e-dc5a9548851a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa552ef-0119-4e6b-86bc-a6d1e675c6db]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:05:04 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:05:04 user nova-compute[73121]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:05:04 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:05:04 user nova-compute[73121]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 (non-flash)
Aug 15 02:05:04 user nova-compute[73121]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:05:04 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e34bbb880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08ac997-90d4-4f47-bf15-ac9150a41563]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e03eb-9b0c-4f18-b2f3-74f23df61c8b]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffb805e-3187-4bb6-a00f-05deaa6ece22]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[84701c3a-2179-4ff3-9cb2-be30d224916d]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e10d95c-43ac-4c74-a144-fcdaa87c2435]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06c06e6-4b1a-4731-beea-7894e25cf729]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260]
Aug 15 02:05:04 user nova-compute[73121]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32, portal: 172.16.0.220,3260] successful.
Aug 15 02:05:04 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84c4d82-7f25-4940-bf81-f97ec0247a32 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1900458c-b50a-4eab-ad8a-d729c1e533c9]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] <== disconnect_volume: return (366ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:05:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Deleting instance files /opt/stack/data/nova/instances/77c8cd9b-475e-4293-9050-c1b2cd8ed015_del
Aug 15 02:05:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Deletion of /opt/stack/data/nova/instances/77c8cd9b-475e-4293-9050-c1b2cd8ed015_del complete
Aug 15 02:05:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:04 user nova-compute[73121]: INFO nova.compute.manager [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Took 2.03 seconds to destroy the instance on the hypervisor.
Aug 15 02:05:04 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:05:04 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:05:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-9af762cf-2072-46c7-8f96-4ff5708446bb req-fae38948-c204-4b39-ae9a-83538cadf4f9 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9af762cf-2072-46c7-8f96-4ff5708446bb req-fae38948-c204-4b39-ae9a-83538cadf4f9 service nova] Acquiring lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9af762cf-2072-46c7-8f96-4ff5708446bb req-fae38948-c204-4b39-ae9a-83538cadf4f9 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9af762cf-2072-46c7-8f96-4ff5708446bb req-fae38948-c204-4b39-ae9a-83538cadf4f9 service nova] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-9af762cf-2072-46c7-8f96-4ff5708446bb req-fae38948-c204-4b39-ae9a-83538cadf4f9 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] No waiting events found dispatching network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:05 user nova-compute[73121]: WARNING nova.compute.manager [req-9af762cf-2072-46c7-8f96-4ff5708446bb req-fae38948-c204-4b39-ae9a-83538cadf4f9 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received unexpected event network-vif-plugged-079356b3-bcfd-429d-a9bd-4f2c93cbf563 for instance with vm_state active and task_state deleting.
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-dcb0f88a-c4c8-4f8d-8372-e5904fc1a716 req-1fe45e2f-ec05-454c-9122-c2105e48f978 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received event network-vif-plugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dcb0f88a-c4c8-4f8d-8372-e5904fc1a716 req-1fe45e2f-ec05-454c-9122-c2105e48f978 service nova] Acquiring lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dcb0f88a-c4c8-4f8d-8372-e5904fc1a716 req-1fe45e2f-ec05-454c-9122-c2105e48f978 service nova] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dcb0f88a-c4c8-4f8d-8372-e5904fc1a716 req-1fe45e2f-ec05-454c-9122-c2105e48f978 service nova] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-dcb0f88a-c4c8-4f8d-8372-e5904fc1a716 req-1fe45e2f-ec05-454c-9122-c2105e48f978 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] No waiting events found dispatching network-vif-plugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:06 user nova-compute[73121]: WARNING nova.compute.manager [req-dcb0f88a-c4c8-4f8d-8372-e5904fc1a716 req-1fe45e2f-ec05-454c-9122-c2105e48f978 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received unexpected event network-vif-plugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b for instance with vm_state building and task_state spawning.
Aug 15 02:05:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:06 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Took 1.40 seconds to deallocate network for instance.
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065106.5669878, cf1d5cbe-cd2e-4a49-bde8-6e196b38994b => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] VM Resumed (Lifecycle Event)
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:05:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Instance spawned successfully.
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065106.5683556, cf1d5cbe-cd2e-4a49-bde8-6e196b38994b => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] VM Started (Lifecycle Event)
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:05:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Took 8.55 seconds to spawn the instance on the hypervisor.
Aug 15 02:05:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Took 9.63 seconds to build instance.
Aug 15 02:05:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ab3f3571-0af9-49f9-8089-b821ff76c834 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.765s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:07 user nova-compute[73121]: INFO nova.compute.manager [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Took 1.01 seconds to detach 1 volumes for instance.
Aug 15 02:05:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Deleting volume: c84c4d82-7f25-4940-bf81-f97ec0247a32 {{(pid=73121) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 02:05:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:07 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:05:07 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:05:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:08 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Deleted allocations for instance 77c8cd9b-475e-4293-9050-c1b2cd8ed015
Aug 15 02:05:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-0ebc4186-463f-4bc3-bb6f-2f08ea8efb88 req-9982cbf9-d803-4fdd-906a-4eddcc85ba55 service nova] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Received event network-vif-deleted-079356b3-bcfd-429d-a9bd-4f2c93cbf563 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d32fd14e-1607-430c-873e-93bc6a3c7589 tempest-ServerActionsV293TestJSON-776954851 tempest-ServerActionsV293TestJSON-776954851-project-member] Lock "77c8cd9b-475e-4293-9050-c1b2cd8ed015" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.452s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:08 user nova-compute[73121]: INFO nova.compute.manager [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Rescuing
Aug 15 02:05:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:05:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquired lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:05:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:05:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:10 user nova-compute[73121]: DEBUG nova.network.neutron [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updating instance_info_cache with network_info: [{"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Releasing lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:05:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-26bc22b8-e65e-4e77-9761-a7c09793e40c req-07fdf374-d743-464e-b9c3-a008fb7ac276 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-26bc22b8-e65e-4e77-9761-a7c09793e40c req-07fdf374-d743-464e-b9c3-a008fb7ac276 service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-26bc22b8-e65e-4e77-9761-a7c09793e40c req-07fdf374-d743-464e-b9c3-a008fb7ac276 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-26bc22b8-e65e-4e77-9761-a7c09793e40c req-07fdf374-d743-464e-b9c3-a008fb7ac276 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-26bc22b8-e65e-4e77-9761-a7c09793e40c req-07fdf374-d743-464e-b9c3-a008fb7ac276 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:11 user nova-compute[73121]: WARNING nova.compute.manager [req-26bc22b8-e65e-4e77-9761-a7c09793e40c req-07fdf374-d743-464e-b9c3-a008fb7ac276 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state active and task_state rescuing.
Aug 15 02:05:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Instance destroyed successfully.
Aug 15 02:05:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Attempting a stable device rescue
Aug 15 02:05:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73121) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Instance directory exists: not creating {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 02:05:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Creating image(s)
Aug 15 02:05:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "/opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "/opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "/opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'trusted_certs' on Instance uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "3d6841e99a0bd61a1eb48b98a5f2c916d47c3632" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "3d6841e99a0bd61a1eb48b98a5f2c916d47c3632" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632.part --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.virt.images [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] c43ab014-b9e3-4507-8d70-cf47cd1a08b1 was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632.part /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:13 user nova-compute[73121]: WARNING nova.compute.manager [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state active and task_state rescuing.
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:13 user nova-compute[73121]: WARNING nova.compute.manager [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state active and task_state rescuing.
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:13 user nova-compute[73121]: WARNING nova.compute.manager [req-fe91bdde-8d4c-4f2e-ba67-f3c648b6c43f req-3ab624ce-3b26-493e-9743-d28d0de2fa1d service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state active and task_state rescuing.
Aug 15 02:05:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632.part /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632.converted" returned: 0 in 0.635s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632.converted --force-share --output=json" returned: 0 in 0.239s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "3d6841e99a0bd61a1eb48b98a5f2c916d47c3632" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.478s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "3d6841e99a0bd61a1eb48b98a5f2c916d47c3632" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "3d6841e99a0bd61a1eb48b98a5f2c916d47c3632" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632 --force-share --output=json" returned: 0 in 0.214s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632,backing_fmt=raw /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632,backing_fmt=raw /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue" returned: 0 in 0.060s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "3d6841e99a0bd61a1eb48b98a5f2c916d47c3632" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.objects.instance [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'migration_context' on Instance uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Start _get_guest_xml network_info=[{"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "vif_mac": "fa:16:3e:c8:62:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c43ab014-b9e3-4507-8d70-cf47cd1a08b1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'cb8438fa-6c99-4ed5-ab33-f863a0a4381b', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoqgwLYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4ec1b1b-8080-462d-8403-a76daf4f42a0', 'serial': 'c4ec1b1b-8080-462d-8403-a76daf4f42a0'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.objects.instance [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'resources' on Instance uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.objects.instance [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'numa_topology' on Instance uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:14 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:14 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.objects.instance [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'vcpu_model' on Instance uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoqgwLYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:05:14 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:05:14 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:05:14 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfdec6c-c4d1-4557-9a35-343c7403b65b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = XoqgwLYh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 02:05:14 user nova-compute[73121]: node.name = iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0
Aug 15 02:05:14 user nova-compute[73121]: node.tpgt = -1
Aug 15 02:05:14 user nova-compute[73121]: node.startup = automatic
Aug 15 02:05:14 user nova-compute[73121]: node.leading_login = No
Aug 15 02:05:14 user nova-compute[73121]: iface.iscsi_ifacename = default
Aug 15 02:05:14 user nova-compute[73121]: iface.net_ifacename = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.ipaddress = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.prefix_len = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.hwaddress = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.transport_name = tcp
Aug 15 02:05:14 user nova-compute[73121]: iface.initiatorname = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.state = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.vlan_id = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.vlan_priority = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.vlan_state = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.iface_num = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.mtu = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.port = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.bootproto = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.subnet_mask = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.gateway = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.dhcp_alt_client_id = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.dhcp_dns = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.dhcp_learn_iqn = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.dhcp_vendor_id_state = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.dhcp_vendor_id = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.dhcp_slp_da = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.fragmentation = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.gratuitous_arp = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.incoming_forwarding = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.tos_state = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.tos = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.ttl = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.delayed_ack = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.tcp_nagle = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.tcp_wsf_state = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.tcp_wsf = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.tcp_timer_scale = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.tcp_timestamp = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.redirect = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.def_task_mgmt_timeout = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.header_digest = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.data_digest = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.immediate_data = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.initial_r2t = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.data_seq_inorder = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.data_pdu_inorder = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.erl = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.max_receive_data_len = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.first_burst_len = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.max_outstanding_r2t = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.max_burst_len = 0
Aug 15 02:05:14 user nova-compute[73121]: iface.chap_auth = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.bidi_chap = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.strict_login_compliance = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.discovery_auth = <empty>
Aug 15 02:05:14 user nova-compute[73121]: iface.discovery_logout = <empty>
Aug 15 02:05:14 user nova-compute[73121]: node.discovery_address = <empty>
Aug 15 02:05:14 user nova-compute[73121]: node.discovery_port = 0
Aug 15 02:05:14 user nova-compute[73121]: node.discovery_type = static
Aug 15 02:05:14 user nova-compute[73121]: node.session.initial_cmdsn = 0
Aug 15 02:05:14 user nova-compute[73121]: node.session.initial_login_retry_max = 8
Aug 15 02:05:14 user nova-compute[73121]: node.session.xmit_thread_priority = -20
Aug 15 02:05:14 user nova-compute[73121]: node.session.cmds_max = 128
Aug 15 02:05:14 user nova-compute[73121]: node.session.queue_depth = 32
Aug 15 02:05:14 user nova-compute[73121]: node.session.nr_sessions = 1
Aug 15 02:05:14 user nova-compute[73121]: node.session.auth.authmethod = CHAP
Aug 15 02:05:14 user nova-compute[73121]: node.session.auth.username = XoqgwLYh
Aug 15 02:05:14 user nova-compute[73121]: node.session.auth.password = ***
Aug 15 02:05:14 user nova-compute[73121]: node.session.auth.username_in = <empty>
Aug 15 02:05:14 user nova-compute[73121]: node.session.auth.password_in = <empty>
Aug 15 02:05:14 user nova-compute[73121]: node.session.auth.chap_algs = MD5
Aug 15 02:05:14 user nova-compute[73121]: node.session.timeo.replacement_timeout = 120
Aug 15 02:05:14 user nova-compute[73121]: node.session.err_timeo.abort_timeout = 15
Aug 15 02:05:14 user nova-compute[73121]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 02:05:14 user nova-compute[73121]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 02:05:14 user nova-compute[73121]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.FastAbort = Yes
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.InitialR2T = No
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.ImmediateData = Yes
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.MaxConnections = 1
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 02:05:14 user nova-compute[73121]: node.session.iscsi.ERL = 0
Aug 15 02:05:14 user nova-compute[73121]: node.session.scan = manual
Aug 15 02:05:14 user nova-compute[73121]: node.session.reopen_max = 0
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].address = 172.16.0.220
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].port = 3260
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].startup = manual
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].tcp.window_size = 524288
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].tcp.type_of_service = 0
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].timeo.logout_timeout = 15
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].timeo.login_timeout = 15
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].timeo.auth_timeout = 45
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].iscsi.DataDigest = None
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].iscsi.IFMarker = No
Aug 15 02:05:14 user nova-compute[73121]: node.conn[0].iscsi.OFMarker = No
Aug 15 02:05:14 user nova-compute[73121]: # END RECORD
Aug 15 02:05:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc252bd-6af5-4d71-8dca-d069d6d2820e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[811a6038-9e29-4698-ac23-6b85baad0902]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoqgwLYh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XoqgwLYh" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0313d2d3-8210-45f4-a380-750392f3a10b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XoqgwLYh'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea510e4-d778-4808-afe7-0b92a33aaf0f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2047d36-b8e4-4d91-96ce-b93423bfbb01]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:05:14 user nova-compute[73121]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:05:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:05:14 user nova-compute[73121]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:05:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] HCTL ('33', '0', '0', 0) found on session 18 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f947e454-6fa9-4f21-9c03-73508f8f8031]: (4, ('0 0 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching for a device in session 18 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoqgwLYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '23461663038333634', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461663038333634', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1758480341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1758480341',id=14,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-75oht42y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:03:42Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "vif_mac": "fa:16:3e:c8:62:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "vif_mac": "fa:16:3e:c8:62:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:62:1b,bridge_name='br-int',has_traffic_filtering=True,id=739b4e0a-f699-4550-8bf7-58935b4c9a18,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b4e0a-f6') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.objects.instance [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'pci_devices' on Instance uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:05:14 user nova-compute[73121]:   <uuid>f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845</uuid>
Aug 15 02:05:14 user nova-compute[73121]:   <name>instance-0000000e</name>
Aug 15 02:05:14 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:05:14 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:05:14 user nova-compute[73121]:   <metadata>
Aug 15 02:05:14 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:05:14 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:05:14 user nova-compute[73121]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1758480341</nova:name>
Aug 15 02:05:14 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:05:14</nova:creationTime>
Aug 15 02:05:14 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:05:14 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:05:14 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:05:14 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:05:14 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:05:14 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:05:14 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:05:14 user nova-compute[73121]:       <nova:owner>
Aug 15 02:05:14 user nova-compute[73121]:         <nova:user uuid="4d8ef0b0581e4a10b066c15119bafde1">tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member</nova:user>
Aug 15 02:05:14 user nova-compute[73121]:         <nova:project uuid="ea879c6a9d1f4d58998e077524a07225">tempest-ServerBootFromVolumeStableRescueTest-893410799</nova:project>
Aug 15 02:05:14 user nova-compute[73121]:       </nova:owner>
Aug 15 02:05:14 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:05:14 user nova-compute[73121]:       <nova:ports>
Aug 15 02:05:14 user nova-compute[73121]:         <nova:port uuid="739b4e0a-f699-4550-8bf7-58935b4c9a18">
Aug 15 02:05:14 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 02:05:14 user nova-compute[73121]:         </nova:port>
Aug 15 02:05:14 user nova-compute[73121]:       </nova:ports>
Aug 15 02:05:14 user nova-compute[73121]:     </nova:instance>
Aug 15 02:05:14 user nova-compute[73121]:   </metadata>
Aug 15 02:05:14 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:05:14 user nova-compute[73121]:     <system>
Aug 15 02:05:14 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:05:14 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:05:14 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:05:14 user nova-compute[73121]:       <entry name="serial">f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845</entry>
Aug 15 02:05:14 user nova-compute[73121]:       <entry name="uuid">f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845</entry>
Aug 15 02:05:14 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:05:14 user nova-compute[73121]:     </system>
Aug 15 02:05:14 user nova-compute[73121]:   </sysinfo>
Aug 15 02:05:14 user nova-compute[73121]:   <os>
Aug 15 02:05:14 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:05:14 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:05:14 user nova-compute[73121]:   </os>
Aug 15 02:05:14 user nova-compute[73121]:   <features>
Aug 15 02:05:14 user nova-compute[73121]:     <acpi/>
Aug 15 02:05:14 user nova-compute[73121]:     <apic/>
Aug 15 02:05:14 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:05:14 user nova-compute[73121]:   </features>
Aug 15 02:05:14 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:05:14 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:05:14 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:05:14 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:05:14 user nova-compute[73121]:   </clock>
Aug 15 02:05:14 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:05:14 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:05:14 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:05:14 user nova-compute[73121]:   </cpu>
Aug 15 02:05:14 user nova-compute[73121]:   <devices>
Aug 15 02:05:14 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:05:14 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:05:14 user nova-compute[73121]:       <source dev="/dev/sdb"/>
Aug 15 02:05:14 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:05:14 user nova-compute[73121]:       <serial>c4ec1b1b-8080-462d-8403-a76daf4f42a0</serial>
Aug 15 02:05:14 user nova-compute[73121]:     </disk>
Aug 15 02:05:14 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:05:14 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:05:14 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue"/>
Aug 15 02:05:14 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:05:14 user nova-compute[73121]:       <boot order="1"/>
Aug 15 02:05:14 user nova-compute[73121]:     </disk>
Aug 15 02:05:14 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:05:14 user nova-compute[73121]:       <mac address="fa:16:3e:c8:62:1b"/>
Aug 15 02:05:14 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:14 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:05:14 user nova-compute[73121]:       <target dev="tap739b4e0a-f6"/>
Aug 15 02:05:14 user nova-compute[73121]:     </interface>
Aug 15 02:05:14 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:05:14 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/console.log" append="off"/>
Aug 15 02:05:14 user nova-compute[73121]:     </serial>
Aug 15 02:05:14 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:05:14 user nova-compute[73121]:     <video>
Aug 15 02:05:14 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:14 user nova-compute[73121]:     </video>
Aug 15 02:05:14 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:05:14 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:05:14 user nova-compute[73121]:     </rng>
Aug 15 02:05:14 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:05:14 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:05:14 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:05:14 user nova-compute[73121]:     </memballoon>
Aug 15 02:05:14 user nova-compute[73121]:   </devices>
Aug 15 02:05:14 user nova-compute[73121]: </domain>
Aug 15 02:05:14 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:05:14 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Instance destroyed successfully.
Aug 15 02:05:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No VIF found with MAC fa:16:3e:c8:62:1b, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:15 user nova-compute[73121]: WARNING nova.compute.manager [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state active and task_state rescuing.
Aug 15 02:05:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:15 user nova-compute[73121]: WARNING nova.compute.manager [req-9cd36815-415f-4e7b-8007-69b546231255 req-2c2efdf5-3104-4647-8fc2-487c52bb1caa service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state active and task_state rescuing.
Aug 15 02:05:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065104.1767454, 77c8cd9b-475e-4293-9050-c1b2cd8ed015 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:19 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] VM Stopped (Lifecycle Event)
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-beb27648-2ad2-4aa3-ad23-05e4e830157b None None] [instance: 77c8cd9b-475e-4293-9050-c1b2cd8ed015] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-160c9d04-edfd-4f9b-909a-c289b90bc64f tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065119.3991182, f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:19 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] VM Resumed (Lifecycle Event)
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:19 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065119.3998537, f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:19 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] VM Started (Lifecycle Event)
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:21 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:21 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7720MB free_disk=25.626346588134766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 4e04a498-4518-46c9-bc49-4d0d5d6aa054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6585e3eb-f7ab-429b-a000-59183bba993a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance cf1d5cbe-cd2e-4a49-bde8-6e196b38994b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:05:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-bbb84989-2ed9-45aa-af61-e301da32e698 req-9596be86-1791-48a1-8e45-c092fd05c8e7 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bbb84989-2ed9-45aa-af61-e301da32e698 req-9596be86-1791-48a1-8e45-c092fd05c8e7 service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bbb84989-2ed9-45aa-af61-e301da32e698 req-9596be86-1791-48a1-8e45-c092fd05c8e7 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bbb84989-2ed9-45aa-af61-e301da32e698 req-9596be86-1791-48a1-8e45-c092fd05c8e7 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-bbb84989-2ed9-45aa-af61-e301da32e698 req-9596be86-1791-48a1-8e45-c092fd05c8e7 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:22 user nova-compute[73121]: WARNING nova.compute.manager [req-bbb84989-2ed9-45aa-af61-e301da32e698 req-9596be86-1791-48a1-8e45-c092fd05c8e7 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state rescued and task_state None.
Aug 15 02:05:22 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.693s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.567s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:05:22 user nova-compute[73121]: INFO nova.compute.claims [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Claim successful on node user
Aug 15 02:05:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:05:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:05:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:05:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Creating image(s)
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "/opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "/opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "/opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG nova.policy [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c1e20e779ac4711803956ee2a2accaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc744b107dc4a8baa3274788b094e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk 1073741824" returned: 0 in 0.063s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:05:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Cannot resize image /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'migration_context' on Instance uuid d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.compute.manager [req-a30891f1-d491-487f-8a8a-489cabe91a3c req-8452accb-f95f-47a5-924f-96a56a400649 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a30891f1-d491-487f-8a8a-489cabe91a3c req-8452accb-f95f-47a5-924f-96a56a400649 service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a30891f1-d491-487f-8a8a-489cabe91a3c req-8452accb-f95f-47a5-924f-96a56a400649 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a30891f1-d491-487f-8a8a-489cabe91a3c req-8452accb-f95f-47a5-924f-96a56a400649 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.compute.manager [req-a30891f1-d491-487f-8a8a-489cabe91a3c req-8452accb-f95f-47a5-924f-96a56a400649 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:24 user nova-compute[73121]: WARNING nova.compute.manager [req-a30891f1-d491-487f-8a8a-489cabe91a3c req-8452accb-f95f-47a5-924f-96a56a400649 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state rescued and task_state None.
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Ensure instance console log exists: /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:05:24 user nova-compute[73121]: INFO nova.compute.claims [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Claim successful on node user
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Successfully created port: 078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:05:25 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:05:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG nova.policy [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f22753e4f3934dddab87961c43c68fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0739b6fd0a4c3097a1e0d329176a78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:05:25 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Creating image(s)
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "/opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "/opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.216s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk 1073741824" returned: 0 in 0.051s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.284s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:05:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquiring lock "1136faf6-d177-41ae-9995-b467eb0ca92c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Successfully created port: 3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Successfully updated port: 078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquired lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Cannot resize image /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'migration_context' on Instance uuid 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Ensure instance console log exists: /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:05:26 user nova-compute[73121]: INFO nova.compute.claims [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Claim successful on node user
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-16cabeb7-3204-46f9-b669-7ae756bb3319 req-1b700b6b-1c56-410f-85a2-ad54358a0183 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received event network-changed-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-16cabeb7-3204-46f9-b669-7ae756bb3319 req-1b700b6b-1c56-410f-85a2-ad54358a0183 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Refreshing instance network info cache due to event network-changed-078c1390-48c5-4a7f-8888-804e5ff491f7. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-16cabeb7-3204-46f9-b669-7ae756bb3319 req-1b700b6b-1c56-410f-85a2-ad54358a0183 service nova] Acquiring lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updating instance_info_cache with network_info: [{"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Releasing lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Instance network_info: |[{"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-16cabeb7-3204-46f9-b669-7ae756bb3319 req-1b700b6b-1c56-410f-85a2-ad54358a0183 service nova] Acquired lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.neutron [req-16cabeb7-3204-46f9-b669-7ae756bb3319 req-1b700b6b-1c56-410f-85a2-ad54358a0183 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Refreshing network info cache for port 078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Start _get_guest_xml network_info=[{"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:05:26 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:26 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-567986943',display_name='tempest-AttachVolumeNegativeTest-server-567986943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-567986943',id=17,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuu5xrWB2IYPqqFD1PXu6xS4ba+afNykvt5/cQRPg9Ug8NypFv+BZ1Edcg5SGrqqAZ+4N6s/OiMnD2baFX3i5dYXK4eEwNclWoA8r9smhMbAoz1pdM6HPpvqFQes/0kiQ==',key_name='tempest-keypair-1393288261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-r71aug21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:05:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=078c1390-48c5-4a7f-8888-804e5ff491f7,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078c1390-48') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'pci_devices' on Instance uuid d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:05:26 user nova-compute[73121]:   <uuid>d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66</uuid>
Aug 15 02:05:26 user nova-compute[73121]:   <name>instance-00000011</name>
Aug 15 02:05:26 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:05:26 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:05:26 user nova-compute[73121]:   <metadata>
Aug 15 02:05:26 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:05:26 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:05:26 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeNegativeTest-server-567986943</nova:name>
Aug 15 02:05:26 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:05:26</nova:creationTime>
Aug 15 02:05:26 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:05:26 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:05:26 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:05:26 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:05:26 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:05:26 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:05:26 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:05:26 user nova-compute[73121]:       <nova:owner>
Aug 15 02:05:26 user nova-compute[73121]:         <nova:user uuid="5c1e20e779ac4711803956ee2a2accaa">tempest-AttachVolumeNegativeTest-2069847524-project-member</nova:user>
Aug 15 02:05:26 user nova-compute[73121]:         <nova:project uuid="fcc744b107dc4a8baa3274788b094e2d">tempest-AttachVolumeNegativeTest-2069847524</nova:project>
Aug 15 02:05:26 user nova-compute[73121]:       </nova:owner>
Aug 15 02:05:26 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:05:26 user nova-compute[73121]:       <nova:ports>
Aug 15 02:05:26 user nova-compute[73121]:         <nova:port uuid="078c1390-48c5-4a7f-8888-804e5ff491f7">
Aug 15 02:05:26 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:05:26 user nova-compute[73121]:         </nova:port>
Aug 15 02:05:26 user nova-compute[73121]:       </nova:ports>
Aug 15 02:05:26 user nova-compute[73121]:     </nova:instance>
Aug 15 02:05:26 user nova-compute[73121]:   </metadata>
Aug 15 02:05:26 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:05:26 user nova-compute[73121]:     <system>
Aug 15 02:05:26 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:05:26 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:05:26 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:05:26 user nova-compute[73121]:       <entry name="serial">d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66</entry>
Aug 15 02:05:26 user nova-compute[73121]:       <entry name="uuid">d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66</entry>
Aug 15 02:05:26 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:05:26 user nova-compute[73121]:     </system>
Aug 15 02:05:26 user nova-compute[73121]:   </sysinfo>
Aug 15 02:05:26 user nova-compute[73121]:   <os>
Aug 15 02:05:26 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:05:26 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:05:26 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:05:26 user nova-compute[73121]:   </os>
Aug 15 02:05:26 user nova-compute[73121]:   <features>
Aug 15 02:05:26 user nova-compute[73121]:     <acpi/>
Aug 15 02:05:26 user nova-compute[73121]:     <apic/>
Aug 15 02:05:26 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:05:26 user nova-compute[73121]:   </features>
Aug 15 02:05:26 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:05:26 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:05:26 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:05:26 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:05:26 user nova-compute[73121]:   </clock>
Aug 15 02:05:26 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:05:26 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:05:26 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:05:26 user nova-compute[73121]:   </cpu>
Aug 15 02:05:26 user nova-compute[73121]:   <devices>
Aug 15 02:05:26 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:05:26 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:05:26 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk"/>
Aug 15 02:05:26 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:05:26 user nova-compute[73121]:     </disk>
Aug 15 02:05:26 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:05:26 user nova-compute[73121]:       <mac address="fa:16:3e:2f:4a:cf"/>
Aug 15 02:05:26 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:26 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:05:26 user nova-compute[73121]:       <target dev="tap078c1390-48"/>
Aug 15 02:05:26 user nova-compute[73121]:     </interface>
Aug 15 02:05:26 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:05:26 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/console.log" append="off"/>
Aug 15 02:05:26 user nova-compute[73121]:     </serial>
Aug 15 02:05:26 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:05:26 user nova-compute[73121]:     <video>
Aug 15 02:05:26 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:26 user nova-compute[73121]:     </video>
Aug 15 02:05:26 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:05:26 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:05:26 user nova-compute[73121]:     </rng>
Aug 15 02:05:26 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:05:26 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:05:26 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:05:26 user nova-compute[73121]:     </memballoon>
Aug 15 02:05:26 user nova-compute[73121]:   </devices>
Aug 15 02:05:26 user nova-compute[73121]: </domain>
Aug 15 02:05:26 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-567986943',display_name='tempest-AttachVolumeNegativeTest-server-567986943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-567986943',id=17,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuu5xrWB2IYPqqFD1PXu6xS4ba+afNykvt5/cQRPg9Ug8NypFv+BZ1Edcg5SGrqqAZ+4N6s/OiMnD2baFX3i5dYXK4eEwNclWoA8r9smhMbAoz1pdM6HPpvqFQes/0kiQ==',key_name='tempest-keypair-1393288261',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-r71aug21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:05:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=078c1390-48c5-4a7f-8888-804e5ff491f7,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078c1390-48') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG os_vif [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=078c1390-48c5-4a7f-8888-804e5ff491f7,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078c1390-48') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap078c1390-48, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap078c1390-48, col_values=(('external_ids', {'iface-id': '078c1390-48c5-4a7f-8888-804e5ff491f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:4a:cf', 'vm-uuid': 'd94b39b6-f39c-4c33-ab3e-8f01c7f8fd66'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:26 user nova-compute[73121]: INFO os_vif [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=078c1390-48c5-4a7f-8888-804e5ff491f7,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078c1390-48')
Aug 15 02:05:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.549s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No VIF found with MAC fa:16:3e:2f:4a:cf, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:05:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:05:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.policy [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1763d11a6a648109e8892ee67ea1e7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59b2f4f3b86441b48aa4aa344023c11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:05:27 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Creating image(s)
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquiring lock "/opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "/opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "/opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Successfully updated port: 3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquired lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.neutron [req-16cabeb7-3204-46f9-b669-7ae756bb3319 req-1b700b6b-1c56-410f-85a2-ad54358a0183 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updated VIF entry in instance network info cache for port 078c1390-48c5-4a7f-8888-804e5ff491f7. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.neutron [req-16cabeb7-3204-46f9-b669-7ae756bb3319 req-1b700b6b-1c56-410f-85a2-ad54358a0183 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updating instance_info_cache with network_info: [{"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-16cabeb7-3204-46f9-b669-7ae756bb3319 req-1b700b6b-1c56-410f-85a2-ad54358a0183 service nova] Releasing lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-b77fb0b9-4820-41c4-86f1-40b14ad1c564 req-873d4b42-7732-4a57-9fd2-3d7cb265ad7e service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received event network-changed-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-b77fb0b9-4820-41c4-86f1-40b14ad1c564 req-873d4b42-7732-4a57-9fd2-3d7cb265ad7e service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Refreshing instance network info cache due to event network-changed-3ce335a5-d497-4e7a-ac6f-0e281c42cafb. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b77fb0b9-4820-41c4-86f1-40b14ad1c564 req-873d4b42-7732-4a57-9fd2-3d7cb265ad7e service nova] Acquiring lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk 1073741824" returned: 0 in 0.064s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Releasing lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Instance network_info: |[{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b77fb0b9-4820-41c4-86f1-40b14ad1c564 req-873d4b42-7732-4a57-9fd2-3d7cb265ad7e service nova] Acquired lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.neutron [req-b77fb0b9-4820-41c4-86f1-40b14ad1c564 req-873d4b42-7732-4a57-9fd2-3d7cb265ad7e service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Refreshing network info cache for port 3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Start _get_guest_xml network_info=[{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Successfully created port: 1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:05:27 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:27 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-107880846',display_name='tempest-ServerActionsTestOtherA-server-107880846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-107880846',id=18,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdD9feBUtKJxWabCOxeEfVUYblkUx99maantL29ickzkNiSka7JcOd7LAkLzENREY7q67OdhUq5n4xklCuCa82bJF6NH8tngV7k73jmjSgmnNbURsM8zWbxOgcKQEI/Q==',key_name='tempest-keypair-556442797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-6f0859bo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=6e8f8819-63bf-4c6c-b485-707c9d7f3f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3ce335a5-d497-4e7a-ac6f-0e281c42cafb,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce335a5-d4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:05:27 user nova-compute[73121]:   <uuid>6e8f8819-63bf-4c6c-b485-707c9d7f3f55</uuid>
Aug 15 02:05:27 user nova-compute[73121]:   <name>instance-00000012</name>
Aug 15 02:05:27 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:05:27 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:05:27 user nova-compute[73121]:   <metadata>
Aug 15 02:05:27 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:05:27 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:05:27 user nova-compute[73121]:       <nova:name>tempest-ServerActionsTestOtherA-server-107880846</nova:name>
Aug 15 02:05:27 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:05:27</nova:creationTime>
Aug 15 02:05:27 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:05:27 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:05:27 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:05:27 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:05:27 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:05:27 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:05:27 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:05:27 user nova-compute[73121]:       <nova:owner>
Aug 15 02:05:27 user nova-compute[73121]:         <nova:user uuid="f22753e4f3934dddab87961c43c68fb2">tempest-ServerActionsTestOtherA-148244694-project-member</nova:user>
Aug 15 02:05:27 user nova-compute[73121]:         <nova:project uuid="fb0739b6fd0a4c3097a1e0d329176a78">tempest-ServerActionsTestOtherA-148244694</nova:project>
Aug 15 02:05:27 user nova-compute[73121]:       </nova:owner>
Aug 15 02:05:27 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:05:27 user nova-compute[73121]:       <nova:ports>
Aug 15 02:05:27 user nova-compute[73121]:         <nova:port uuid="3ce335a5-d497-4e7a-ac6f-0e281c42cafb">
Aug 15 02:05:27 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 02:05:27 user nova-compute[73121]:         </nova:port>
Aug 15 02:05:27 user nova-compute[73121]:       </nova:ports>
Aug 15 02:05:27 user nova-compute[73121]:     </nova:instance>
Aug 15 02:05:27 user nova-compute[73121]:   </metadata>
Aug 15 02:05:27 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:05:27 user nova-compute[73121]:     <system>
Aug 15 02:05:27 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:05:27 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:05:27 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:05:27 user nova-compute[73121]:       <entry name="serial">6e8f8819-63bf-4c6c-b485-707c9d7f3f55</entry>
Aug 15 02:05:27 user nova-compute[73121]:       <entry name="uuid">6e8f8819-63bf-4c6c-b485-707c9d7f3f55</entry>
Aug 15 02:05:27 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:05:27 user nova-compute[73121]:     </system>
Aug 15 02:05:27 user nova-compute[73121]:   </sysinfo>
Aug 15 02:05:27 user nova-compute[73121]:   <os>
Aug 15 02:05:27 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:05:27 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:05:27 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:05:27 user nova-compute[73121]:   </os>
Aug 15 02:05:27 user nova-compute[73121]:   <features>
Aug 15 02:05:27 user nova-compute[73121]:     <acpi/>
Aug 15 02:05:27 user nova-compute[73121]:     <apic/>
Aug 15 02:05:27 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:05:27 user nova-compute[73121]:   </features>
Aug 15 02:05:27 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:05:27 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:05:27 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:05:27 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:05:27 user nova-compute[73121]:   </clock>
Aug 15 02:05:27 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:05:27 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:05:27 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:05:27 user nova-compute[73121]:   </cpu>
Aug 15 02:05:27 user nova-compute[73121]:   <devices>
Aug 15 02:05:27 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:05:27 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:05:27 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk"/>
Aug 15 02:05:27 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:05:27 user nova-compute[73121]:     </disk>
Aug 15 02:05:27 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:05:27 user nova-compute[73121]:       <mac address="fa:16:3e:5e:1e:e7"/>
Aug 15 02:05:27 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:27 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:05:27 user nova-compute[73121]:       <target dev="tap3ce335a5-d4"/>
Aug 15 02:05:27 user nova-compute[73121]:     </interface>
Aug 15 02:05:27 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:05:27 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/console.log" append="off"/>
Aug 15 02:05:27 user nova-compute[73121]:     </serial>
Aug 15 02:05:27 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:05:27 user nova-compute[73121]:     <video>
Aug 15 02:05:27 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:27 user nova-compute[73121]:     </video>
Aug 15 02:05:27 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:05:27 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:05:27 user nova-compute[73121]:     </rng>
Aug 15 02:05:27 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:05:27 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:05:27 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:05:27 user nova-compute[73121]:     </memballoon>
Aug 15 02:05:27 user nova-compute[73121]:   </devices>
Aug 15 02:05:27 user nova-compute[73121]: </domain>
Aug 15 02:05:27 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-107880846',display_name='tempest-ServerActionsTestOtherA-server-107880846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-107880846',id=18,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdD9feBUtKJxWabCOxeEfVUYblkUx99maantL29ickzkNiSka7JcOd7LAkLzENREY7q67OdhUq5n4xklCuCa82bJF6NH8tngV7k73jmjSgmnNbURsM8zWbxOgcKQEI/Q==',key_name='tempest-keypair-556442797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-6f0859bo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:05:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=6e8f8819-63bf-4c6c-b485-707c9d7f3f55,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3ce335a5-d497-4e7a-ac6f-0e281c42cafb,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce335a5-d4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG os_vif [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3ce335a5-d497-4e7a-ac6f-0e281c42cafb,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce335a5-d4') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Cannot resize image /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lazy-loading 'migration_context' on Instance uuid 1136faf6-d177-41ae-9995-b467eb0ca92c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ce335a5-d4, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ce335a5-d4, col_values=(('external_ids', {'iface-id': '3ce335a5-d497-4e7a-ac6f-0e281c42cafb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:1e:e7', 'vm-uuid': '6e8f8819-63bf-4c6c-b485-707c9d7f3f55'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Ensure instance console log exists: /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:27 user nova-compute[73121]: INFO os_vif [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:1e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3ce335a5-d497-4e7a-ac6f-0e281c42cafb,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce335a5-d4')
Aug 15 02:05:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No VIF found with MAC fa:16:3e:5e:1e:e7, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG nova.network.neutron [req-b77fb0b9-4820-41c4-86f1-40b14ad1c564 req-873d4b42-7732-4a57-9fd2-3d7cb265ad7e service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updated VIF entry in instance network info cache for port 3ce335a5-d497-4e7a-ac6f-0e281c42cafb. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG nova.network.neutron [req-b77fb0b9-4820-41c4-86f1-40b14ad1c564 req-873d4b42-7732-4a57-9fd2-3d7cb265ad7e service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b77fb0b9-4820-41c4-86f1-40b14ad1c564 req-873d4b42-7732-4a57-9fd2-3d7cb265ad7e service nova] Releasing lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Successfully updated port: 1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquiring lock "refresh_cache-1136faf6-d177-41ae-9995-b467eb0ca92c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquired lock "refresh_cache-1136faf6-d177-41ae-9995-b467eb0ca92c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-e70eadde-39f0-4e16-9715-a5564eb0fa2f req-ae4f34b6-dc5b-42bc-bf89-696359ee2211 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received event network-changed-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-e70eadde-39f0-4e16-9715-a5564eb0fa2f req-ae4f34b6-dc5b-42bc-bf89-696359ee2211 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Refreshing instance network info cache due to event network-changed-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e70eadde-39f0-4e16-9715-a5564eb0fa2f req-ae4f34b6-dc5b-42bc-bf89-696359ee2211 service nova] Acquiring lock "refresh_cache-1136faf6-d177-41ae-9995-b467eb0ca92c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Updating instance_info_cache with network_info: [{"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Releasing lock "refresh_cache-1136faf6-d177-41ae-9995-b467eb0ca92c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Instance network_info: |[{"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e70eadde-39f0-4e16-9715-a5564eb0fa2f req-ae4f34b6-dc5b-42bc-bf89-696359ee2211 service nova] Acquired lock "refresh_cache-1136faf6-d177-41ae-9995-b467eb0ca92c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.network.neutron [req-e70eadde-39f0-4e16-9715-a5564eb0fa2f req-ae4f34b6-dc5b-42bc-bf89-696359ee2211 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Refreshing network info cache for port 1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Start _get_guest_xml network_info=[{"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:05:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-21145170',display_name='tempest-VolumesNegativeTest-instance-21145170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-21145170',id=19,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b2f4f3b86441b48aa4aa344023c11e',ramdisk_id='',reservation_id='r-8w47aefj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1910220218',owner_user_name='tempest-VolumesNegativeTest-1910220218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:05:27Z,user_data=None,user_id='a1763d11a6a648109e8892ee67ea1e7c',uuid=1136faf6-d177-41ae-9995-b467eb0ca92c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Converting VIF {"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:1b:a0,bridge_name='br-int',has_traffic_filtering=True,id=1feb94ce-e4fb-4aa1-a4f7-89378e9cd408,network=Network(0c98637f-5dca-42aa-9675-d7a74528e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feb94ce-e4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lazy-loading 'pci_devices' on Instance uuid 1136faf6-d177-41ae-9995-b467eb0ca92c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:05:29 user nova-compute[73121]:   <uuid>1136faf6-d177-41ae-9995-b467eb0ca92c</uuid>
Aug 15 02:05:29 user nova-compute[73121]:   <name>instance-00000013</name>
Aug 15 02:05:29 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:05:29 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:05:29 user nova-compute[73121]:   <metadata>
Aug 15 02:05:29 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:05:29 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:05:29 user nova-compute[73121]:       <nova:name>tempest-VolumesNegativeTest-instance-21145170</nova:name>
Aug 15 02:05:29 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:05:29</nova:creationTime>
Aug 15 02:05:29 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:05:29 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:05:29 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:05:29 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:05:29 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:05:29 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:05:29 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:05:29 user nova-compute[73121]:       <nova:owner>
Aug 15 02:05:29 user nova-compute[73121]:         <nova:user uuid="a1763d11a6a648109e8892ee67ea1e7c">tempest-VolumesNegativeTest-1910220218-project-member</nova:user>
Aug 15 02:05:29 user nova-compute[73121]:         <nova:project uuid="59b2f4f3b86441b48aa4aa344023c11e">tempest-VolumesNegativeTest-1910220218</nova:project>
Aug 15 02:05:29 user nova-compute[73121]:       </nova:owner>
Aug 15 02:05:29 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:05:29 user nova-compute[73121]:       <nova:ports>
Aug 15 02:05:29 user nova-compute[73121]:         <nova:port uuid="1feb94ce-e4fb-4aa1-a4f7-89378e9cd408">
Aug 15 02:05:29 user nova-compute[73121]:           <nova:ip type="fixed" address="192.168.233.223" ipVersion="4"/>
Aug 15 02:05:29 user nova-compute[73121]:         </nova:port>
Aug 15 02:05:29 user nova-compute[73121]:       </nova:ports>
Aug 15 02:05:29 user nova-compute[73121]:     </nova:instance>
Aug 15 02:05:29 user nova-compute[73121]:   </metadata>
Aug 15 02:05:29 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:05:29 user nova-compute[73121]:     <system>
Aug 15 02:05:29 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:05:29 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:05:29 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:05:29 user nova-compute[73121]:       <entry name="serial">1136faf6-d177-41ae-9995-b467eb0ca92c</entry>
Aug 15 02:05:29 user nova-compute[73121]:       <entry name="uuid">1136faf6-d177-41ae-9995-b467eb0ca92c</entry>
Aug 15 02:05:29 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:05:29 user nova-compute[73121]:     </system>
Aug 15 02:05:29 user nova-compute[73121]:   </sysinfo>
Aug 15 02:05:29 user nova-compute[73121]:   <os>
Aug 15 02:05:29 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:05:29 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:05:29 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:05:29 user nova-compute[73121]:   </os>
Aug 15 02:05:29 user nova-compute[73121]:   <features>
Aug 15 02:05:29 user nova-compute[73121]:     <acpi/>
Aug 15 02:05:29 user nova-compute[73121]:     <apic/>
Aug 15 02:05:29 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:05:29 user nova-compute[73121]:   </features>
Aug 15 02:05:29 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:05:29 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:05:29 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:05:29 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:05:29 user nova-compute[73121]:   </clock>
Aug 15 02:05:29 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:05:29 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:05:29 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:05:29 user nova-compute[73121]:   </cpu>
Aug 15 02:05:29 user nova-compute[73121]:   <devices>
Aug 15 02:05:29 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:05:29 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:05:29 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk"/>
Aug 15 02:05:29 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:05:29 user nova-compute[73121]:     </disk>
Aug 15 02:05:29 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:05:29 user nova-compute[73121]:       <mac address="fa:16:3e:26:1b:a0"/>
Aug 15 02:05:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:29 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:05:29 user nova-compute[73121]:       <target dev="tap1feb94ce-e4"/>
Aug 15 02:05:29 user nova-compute[73121]:     </interface>
Aug 15 02:05:29 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:05:29 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/console.log" append="off"/>
Aug 15 02:05:29 user nova-compute[73121]:     </serial>
Aug 15 02:05:29 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:05:29 user nova-compute[73121]:     <video>
Aug 15 02:05:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:05:29 user nova-compute[73121]:     </video>
Aug 15 02:05:29 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:05:29 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:05:29 user nova-compute[73121]:     </rng>
Aug 15 02:05:29 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:05:29 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:05:29 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:05:29 user nova-compute[73121]:     </memballoon>
Aug 15 02:05:29 user nova-compute[73121]:   </devices>
Aug 15 02:05:29 user nova-compute[73121]: </domain>
Aug 15 02:05:29 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-21145170',display_name='tempest-VolumesNegativeTest-instance-21145170',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-21145170',id=19,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59b2f4f3b86441b48aa4aa344023c11e',ramdisk_id='',reservation_id='r-8w47aefj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1910220218',owner_user_name='tempest-VolumesNegativeTest-1910220218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:05:27Z,user_data=None,user_id='a1763d11a6a648109e8892ee67ea1e7c',uuid=1136faf6-d177-41ae-9995-b467eb0ca92c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Converting VIF {"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:1b:a0,bridge_name='br-int',has_traffic_filtering=True,id=1feb94ce-e4fb-4aa1-a4f7-89378e9cd408,network=Network(0c98637f-5dca-42aa-9675-d7a74528e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feb94ce-e4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG os_vif [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:1b:a0,bridge_name='br-int',has_traffic_filtering=True,id=1feb94ce-e4fb-4aa1-a4f7-89378e9cd408,network=Network(0c98637f-5dca-42aa-9675-d7a74528e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feb94ce-e4') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1feb94ce-e4, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1feb94ce-e4, col_values=(('external_ids', {'iface-id': '1feb94ce-e4fb-4aa1-a4f7-89378e9cd408', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:1b:a0', 'vm-uuid': '1136faf6-d177-41ae-9995-b467eb0ca92c'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:29 user nova-compute[73121]: INFO os_vif [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:1b:a0,bridge_name='br-int',has_traffic_filtering=True,id=1feb94ce-e4fb-4aa1-a4f7-89378e9cd408,network=Network(0c98637f-5dca-42aa-9675-d7a74528e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feb94ce-e4')
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] No VIF found with MAC fa:16:3e:26:1b:a0, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-66e919d9-a8c8-434f-86f8-0f65d16afbd4 req-1d621c32-06d9-4451-b76c-d344370872c3 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received event network-vif-plugged-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-66e919d9-a8c8-434f-86f8-0f65d16afbd4 req-1d621c32-06d9-4451-b76c-d344370872c3 service nova] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-66e919d9-a8c8-434f-86f8-0f65d16afbd4 req-1d621c32-06d9-4451-b76c-d344370872c3 service nova] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-66e919d9-a8c8-434f-86f8-0f65d16afbd4 req-1d621c32-06d9-4451-b76c-d344370872c3 service nova] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-66e919d9-a8c8-434f-86f8-0f65d16afbd4 req-1d621c32-06d9-4451-b76c-d344370872c3 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] No waiting events found dispatching network-vif-plugged-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:29 user nova-compute[73121]: WARNING nova.compute.manager [req-66e919d9-a8c8-434f-86f8-0f65d16afbd4 req-1d621c32-06d9-4451-b76c-d344370872c3 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received unexpected event network-vif-plugged-078c1390-48c5-4a7f-8888-804e5ff491f7 for instance with vm_state building and task_state spawning.
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:30 user nova-compute[73121]: DEBUG nova.network.neutron [req-e70eadde-39f0-4e16-9715-a5564eb0fa2f req-ae4f34b6-dc5b-42bc-bf89-696359ee2211 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Updated VIF entry in instance network info cache for port 1feb94ce-e4fb-4aa1-a4f7-89378e9cd408. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:05:30 user nova-compute[73121]: DEBUG nova.network.neutron [req-e70eadde-39f0-4e16-9715-a5564eb0fa2f req-ae4f34b6-dc5b-42bc-bf89-696359ee2211 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Updating instance_info_cache with network_info: [{"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:05:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e70eadde-39f0-4e16-9715-a5564eb0fa2f req-ae4f34b6-dc5b-42bc-bf89-696359ee2211 service nova] Releasing lock "refresh_cache-1136faf6-d177-41ae-9995-b467eb0ca92c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:05:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received event network-vif-plugged-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] No waiting events found dispatching network-vif-plugged-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:31 user nova-compute[73121]: WARNING nova.compute.manager [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received unexpected event network-vif-plugged-078c1390-48c5-4a7f-8888-804e5ff491f7 for instance with vm_state building and task_state spawning.
Aug 15 02:05:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received event network-vif-plugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] Acquiring lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] No waiting events found dispatching network-vif-plugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:31 user nova-compute[73121]: WARNING nova.compute.manager [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received unexpected event network-vif-plugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb for instance with vm_state building and task_state spawning.
Aug 15 02:05:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received event network-vif-plugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] Acquiring lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] No waiting events found dispatching network-vif-plugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:31 user nova-compute[73121]: WARNING nova.compute.manager [req-cdcf8ac1-9103-449a-8244-77b599e75e6a req-d29201cc-53ac-4c7a-8513-46bfa50a5c19 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received unexpected event network-vif-plugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb for instance with vm_state building and task_state spawning.
Aug 15 02:05:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-fda7872a-cb02-4675-a93a-44841980b1f3 req-bbe02467-316d-4e1f-af64-87c11f8a84ff service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received event network-vif-plugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fda7872a-cb02-4675-a93a-44841980b1f3 req-bbe02467-316d-4e1f-af64-87c11f8a84ff service nova] Acquiring lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fda7872a-cb02-4675-a93a-44841980b1f3 req-bbe02467-316d-4e1f-af64-87c11f8a84ff service nova] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fda7872a-cb02-4675-a93a-44841980b1f3 req-bbe02467-316d-4e1f-af64-87c11f8a84ff service nova] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-fda7872a-cb02-4675-a93a-44841980b1f3 req-bbe02467-316d-4e1f-af64-87c11f8a84ff service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] No waiting events found dispatching network-vif-plugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:32 user nova-compute[73121]: WARNING nova.compute.manager [req-fda7872a-cb02-4675-a93a-44841980b1f3 req-bbe02467-316d-4e1f-af64-87c11f8a84ff service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received unexpected event network-vif-plugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 for instance with vm_state building and task_state spawning.
Aug 15 02:05:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065133.2290657, d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] VM Resumed (Lifecycle Event)
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Instance spawned successfully.
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065133.2331648, d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] VM Started (Lifecycle Event)
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Took 10.13 seconds to spawn the instance on the hypervisor.
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Took 11.84 seconds to build instance.
Aug 15 02:05:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0caedc8e-428f-4d2b-9f4c-a28c3eb0f617 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.974s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065133.5570421, 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] VM Resumed (Lifecycle Event)
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Instance spawned successfully.
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065133.5574691, 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] VM Started (Lifecycle Event)
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Took 8.47 seconds to spawn the instance on the hypervisor.
Aug 15 02:05:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:33 user nova-compute[73121]: INFO nova.compute.manager [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Took 9.42 seconds to build instance.
Aug 15 02:05:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fe80d13-a941-4285-83b8-91f3f020b30f tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.537s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065134.100999, 1136faf6-d177-41ae-9995-b467eb0ca92c => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] VM Resumed (Lifecycle Event)
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:05:34 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Instance spawned successfully.
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-2495e13e-9d73-4456-9026-c4b2009ca7b4 req-8c601642-349f-4718-bedf-82c55e25dbf0 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received event network-vif-plugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2495e13e-9d73-4456-9026-c4b2009ca7b4 req-8c601642-349f-4718-bedf-82c55e25dbf0 service nova] Acquiring lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2495e13e-9d73-4456-9026-c4b2009ca7b4 req-8c601642-349f-4718-bedf-82c55e25dbf0 service nova] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2495e13e-9d73-4456-9026-c4b2009ca7b4 req-8c601642-349f-4718-bedf-82c55e25dbf0 service nova] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-2495e13e-9d73-4456-9026-c4b2009ca7b4 req-8c601642-349f-4718-bedf-82c55e25dbf0 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] No waiting events found dispatching network-vif-plugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:05:34 user nova-compute[73121]: WARNING nova.compute.manager [req-2495e13e-9d73-4456-9026-c4b2009ca7b4 req-8c601642-349f-4718-bedf-82c55e25dbf0 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received unexpected event network-vif-plugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 for instance with vm_state building and task_state spawning.
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:05:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065134.1042402, 1136faf6-d177-41ae-9995-b467eb0ca92c => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:05:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] VM Started (Lifecycle Event)
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:05:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:05:34 user nova-compute[73121]: INFO nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Took 7.21 seconds to spawn the instance on the hypervisor.
Aug 15 02:05:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:05:34 user nova-compute[73121]: INFO nova.compute.manager [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Took 8.18 seconds to build instance.
Aug 15 02:05:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f813597d-e690-4529-82c1-7bf86fa2b860 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.300s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:05:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:05:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "6585e3eb-f7ab-429b-a000-59183bba993a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "6585e3eb-f7ab-429b-a000-59183bba993a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:07 user nova-compute[73121]: INFO nova.compute.manager [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Terminating instance
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-5967bdbc-9309-4c9a-8425-4c5f637bfa1d req-9668a77f-6020-449e-9551-452977eb2ad5 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received event network-vif-unplugged-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5967bdbc-9309-4c9a-8425-4c5f637bfa1d req-9668a77f-6020-449e-9551-452977eb2ad5 service nova] Acquiring lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5967bdbc-9309-4c9a-8425-4c5f637bfa1d req-9668a77f-6020-449e-9551-452977eb2ad5 service nova] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5967bdbc-9309-4c9a-8425-4c5f637bfa1d req-9668a77f-6020-449e-9551-452977eb2ad5 service nova] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-5967bdbc-9309-4c9a-8425-4c5f637bfa1d req-9668a77f-6020-449e-9551-452977eb2ad5 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] No waiting events found dispatching network-vif-unplugged-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-5967bdbc-9309-4c9a-8425-4c5f637bfa1d req-9668a77f-6020-449e-9551-452977eb2ad5 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received event network-vif-unplugged-d9d060a8-9206-4e60-b670-9b287c7b825f for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:06:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Instance destroyed successfully.
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.objects.instance [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lazy-loading 'resources' on Instance uuid 6585e3eb-f7ab-429b-a000-59183bba993a {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:04:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1756626552',display_name='tempest-VolumesAdminNegativeTest-server-1756626552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1756626552',id=15,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:04:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfd8c0c79b374093bfdd9fa70538769f',ramdisk_id='',reservation_id='r-zwoa0i02',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-465693716',owner_user_name='tempest-VolumesAdminNegativeTest-465693716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:04:13Z,user_data=None,user_id='ae827293f6984ad78b5361b415b78a27',uuid=6585e3eb-f7ab-429b-a000-59183bba993a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converting VIF {"id": "d9d060a8-9206-4e60-b670-9b287c7b825f", "address": "fa:16:3e:69:5e:b0", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9d060a8-92", "ovs_interfaceid": "d9d060a8-9206-4e60-b670-9b287c7b825f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:5e:b0,bridge_name='br-int',has_traffic_filtering=True,id=d9d060a8-9206-4e60-b670-9b287c7b825f,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d060a8-92') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG os_vif [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:5e:b0,bridge_name='br-int',has_traffic_filtering=True,id=d9d060a8-9206-4e60-b670-9b287c7b825f,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d060a8-92') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9d060a8-92, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:07 user nova-compute[73121]: INFO os_vif [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:5e:b0,bridge_name='br-int',has_traffic_filtering=True,id=d9d060a8-9206-4e60-b670-9b287c7b825f,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9d060a8-92')
Aug 15 02:06:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Deleting instance files /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a_del
Aug 15 02:06:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Deletion of /opt/stack/data/nova/instances/6585e3eb-f7ab-429b-a000-59183bba993a_del complete
Aug 15 02:06:07 user nova-compute[73121]: INFO nova.compute.manager [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 15 02:06:07 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:06:07 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:06:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:06:08 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:06:08 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Took 1.19 seconds to deallocate network for instance.
Aug 15 02:06:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:09 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:06:09 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:06:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:09 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Deleted allocations for instance 6585e3eb-f7ab-429b-a000-59183bba993a
Aug 15 02:06:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4270fd68-dfe4-438d-9fb4-333eb8f7b49d tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "6585e3eb-f7ab-429b-a000-59183bba993a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.419s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-6bf0c5ee-2344-4033-89a3-2d96e7047796 req-ee1b04b4-c4a0-4152-b064-68985087c538 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received event network-vif-plugged-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:06:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6bf0c5ee-2344-4033-89a3-2d96e7047796 req-ee1b04b4-c4a0-4152-b064-68985087c538 service nova] Acquiring lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6bf0c5ee-2344-4033-89a3-2d96e7047796 req-ee1b04b4-c4a0-4152-b064-68985087c538 service nova] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6bf0c5ee-2344-4033-89a3-2d96e7047796 req-ee1b04b4-c4a0-4152-b064-68985087c538 service nova] Lock "6585e3eb-f7ab-429b-a000-59183bba993a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-6bf0c5ee-2344-4033-89a3-2d96e7047796 req-ee1b04b4-c4a0-4152-b064-68985087c538 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] No waiting events found dispatching network-vif-plugged-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:06:09 user nova-compute[73121]: WARNING nova.compute.manager [req-6bf0c5ee-2344-4033-89a3-2d96e7047796 req-ee1b04b4-c4a0-4152-b064-68985087c538 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received unexpected event network-vif-plugged-d9d060a8-9206-4e60-b670-9b287c7b825f for instance with vm_state deleted and task_state None.
Aug 15 02:06:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-6bf0c5ee-2344-4033-89a3-2d96e7047796 req-ee1b04b4-c4a0-4152-b064-68985087c538 service nova] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Received event network-vif-deleted-d9d060a8-9206-4e60-b670-9b287c7b825f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:06:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid ad8b33e3-c58c-4182-a43a-248f5f1face1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updating instance_info_cache with network_info: [{"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:06:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:15 user nova-compute[73121]: INFO nova.compute.manager [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Detaching volume 77a6f9a6-c8fa-429d-9c83-c270ccb11f5a
Aug 15 02:06:15 user nova-compute[73121]: INFO nova.virt.block_device [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Attempting to driver detach volume 77a6f9a6-c8fa-429d-9c83-c270ccb11f5a from mountpoint /dev/vdb
Aug 15 02:06:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Attempting to detach device vdb from instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:06:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:06:15 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:06:15 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:06:15 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:06:15 user nova-compute[73121]:   <serial>77a6f9a6-c8fa-429d-9c83-c270ccb11f5a</serial>
Aug 15 02:06:15 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 02:06:15 user nova-compute[73121]: </disk>
Aug 15 02:06:15 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:06:15 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully detached device vdb from instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 from the persistent domain config.
Aug 15 02:06:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:06:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:06:15 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:06:15 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:06:15 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:06:15 user nova-compute[73121]:   <serial>77a6f9a6-c8fa-429d-9c83-c270ccb11f5a</serial>
Aug 15 02:06:15 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 02:06:15 user nova-compute[73121]: </disk>
Aug 15 02:06:15 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065176.1501615, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:06:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully detached device vdb from instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 from the live domain config.
Aug 15 02:06:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lUjcPaqL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:06:16 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdbe8209-c0ab-4c46-ad7c-90639699ea81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[980bc0f2-e568-4fe2-bd22-2b94b98fbf3d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:06:16 user nova-compute[73121]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:06:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:06:16 user nova-compute[73121]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a (non-flash)
Aug 15 02:06:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc78a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a'): ({'sdd'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Removing single pathed devices sdd {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[634a1cec-6bb2-44fc-a9a0-188b906593cf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b712b1d7-5db4-4b0f-a16d-0946e61cb4e7]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flushing IO for device /dev/sdd {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e01161-4746-4dea-afcb-b6084570067c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8346de-8543-4860-8d45-fec4b3ee0c97]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc43b2fc-629d-4ca0-b7ac-672130f494bc]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adc0979-4ea7-4090-bebb-5be98ada4a53]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260]
Aug 15 02:06:16 user nova-compute[73121]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a, portal: 172.16.0.220,3260] successful.
Aug 15 02:06:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77a6f9a6-c8fa-429d-9c83-c270ccb11f5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b50b18-0f14-4c40-9798-82634e8d7faa]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== disconnect_volume: return (314ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:06:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:06:17 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:17 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:06:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:06:17 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:17 user nova-compute[73121]: DEBUG nova.objects.instance [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:06:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-861cf78e-fc28-4fd4-a173-47cdbe2042fc tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.886s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57e1661b-35e6-43c2-af5f-6578a40f0a3b tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57e1661b-35e6-43c2-af5f-6578a40f0a3b tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57e1661b-35e6-43c2-af5f-6578a40f0a3b tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57e1661b-35e6-43c2-af5f-6578a40f0a3b tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73121) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG nova.objects.instance [None req-57e1661b-35e6-43c2-af5f-6578a40f0a3b tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-9eee2c9c-ec96-4de7-895a-a06dcb7dd534 req-714de6e5-57cd-420f-a65f-2d5537503cd9 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9eee2c9c-ec96-4de7-895a-a06dcb7dd534 req-714de6e5-57cd-420f-a65f-2d5537503cd9 service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9eee2c9c-ec96-4de7-895a-a06dcb7dd534 req-714de6e5-57cd-420f-a65f-2d5537503cd9 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9eee2c9c-ec96-4de7-895a-a06dcb7dd534 req-714de6e5-57cd-420f-a65f-2d5537503cd9 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-9eee2c9c-ec96-4de7-895a-a06dcb7dd534 req-714de6e5-57cd-420f-a65f-2d5537503cd9 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:06:18 user nova-compute[73121]: WARNING nova.compute.manager [req-9eee2c9c-ec96-4de7-895a-a06dcb7dd534 req-714de6e5-57cd-420f-a65f-2d5537503cd9 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state active and task_state powering-off.
Aug 15 02:06:18 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance destroyed successfully.
Aug 15 02:06:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57e1661b-35e6-43c2-af5f-6578a40f0a3b tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:06:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57e1661b-35e6-43c2-af5f-6578a40f0a3b tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.878s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:06:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG nova.compute.manager [req-6822a3e4-332b-4901-b95d-4ce8a572e798 req-0553d7df-59c2-4bf9-b4f4-0eb28df9b8b4 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6822a3e4-332b-4901-b95d-4ce8a572e798 req-0553d7df-59c2-4bf9-b4f4-0eb28df9b8b4 service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6822a3e4-332b-4901-b95d-4ce8a572e798 req-0553d7df-59c2-4bf9-b4f4-0eb28df9b8b4 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6822a3e4-332b-4901-b95d-4ce8a572e798 req-0553d7df-59c2-4bf9-b4f4-0eb28df9b8b4 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG nova.compute.manager [req-6822a3e4-332b-4901-b95d-4ce8a572e798 req-0553d7df-59c2-4bf9-b4f4-0eb28df9b8b4 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:06:20 user nova-compute[73121]: WARNING nova.compute.manager [req-6822a3e4-332b-4901-b95d-4ce8a572e798 req-0553d7df-59c2-4bf9-b4f4-0eb28df9b8b4 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state None.
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:06:22 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065167.6094725, 6585e3eb-f7ab-429b-a000-59183bba993a => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:06:22 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] VM Stopped (Lifecycle Event)
Aug 15 02:06:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-890a9e83-9b70-4659-9163-2e362a05393c None None] [instance: 6585e3eb-f7ab-429b-a000-59183bba993a] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:06:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:06:23 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:06:23 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7286MB free_disk=25.52361297607422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 4e04a498-4518-46c9-bc49-4d0d5d6aa054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance cf1d5cbe-cd2e-4a49-bde8-6e196b38994b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1136faf6-d177-41ae-9995-b467eb0ca92c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:06:23 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:06:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:06:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.817s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:33 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065178.8414006, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:06:33 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] VM Stopped (Lifecycle Event)
Aug 15 02:06:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-47f01a29-1809-469f-b0f0-9381abbb6b88 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:06:33 user nova-compute[73121]: DEBUG nova.compute.manager [None req-47f01a29-1809-469f-b0f0-9381abbb6b88 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:06:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:06:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:06:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:06:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:06:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid ad8b33e3-c58c-4182-a43a-248f5f1face1 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 4e04a498-4518-46c9-bc49-4d0d5d6aa054 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid cf1d5cbe-cd2e-4a49-bde8-6e196b38994b {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 1136faf6-d177-41ae-9995-b467eb0ca92c {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "1136faf6-d177-41ae-9995-b467eb0ca92c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:06:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:06:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:47 user nova-compute[73121]: INFO nova.compute.manager [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Terminating instance
Aug 15 02:06:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-a77eb43f-b234-4e62-a910-628cb54494d3 req-5b5231cc-b235-4057-843c-ea20a54c1cf6 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received event network-vif-unplugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a77eb43f-b234-4e62-a910-628cb54494d3 req-5b5231cc-b235-4057-843c-ea20a54c1cf6 service nova] Acquiring lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a77eb43f-b234-4e62-a910-628cb54494d3 req-5b5231cc-b235-4057-843c-ea20a54c1cf6 service nova] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a77eb43f-b234-4e62-a910-628cb54494d3 req-5b5231cc-b235-4057-843c-ea20a54c1cf6 service nova] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-a77eb43f-b234-4e62-a910-628cb54494d3 req-5b5231cc-b235-4057-843c-ea20a54c1cf6 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] No waiting events found dispatching network-vif-unplugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-a77eb43f-b234-4e62-a910-628cb54494d3 req-5b5231cc-b235-4057-843c-ea20a54c1cf6 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received event network-vif-unplugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:06:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Instance destroyed successfully.
Aug 15 02:06:48 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lazy-loading 'resources' on Instance uuid cf1d5cbe-cd2e-4a49-bde8-6e196b38994b {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-291551951',display_name='tempest-VolumesActionsTest-instance-291551951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-291551951',id=16,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:05:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65be7e8458ae4063b08bdf6cca18f36e',ramdisk_id='',reservation_id='r-m2ab480k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-469015841',owner_user_name='tempest-VolumesActionsTest-469015841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:05:07Z,user_data=None,user_id='c4c4cfb8a12443a4925a3f8d0814abd8',uuid=cf1d5cbe-cd2e-4a49-bde8-6e196b38994b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converting VIF {"id": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "address": "fa:16:3e:4b:cb:3b", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74de9087-2d", "ovs_interfaceid": "74de9087-2de4-4c14-bfb0-b7eca174aa8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:3b,bridge_name='br-int',has_traffic_filtering=True,id=74de9087-2de4-4c14-bfb0-b7eca174aa8b,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de9087-2d') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG os_vif [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:3b,bridge_name='br-int',has_traffic_filtering=True,id=74de9087-2de4-4c14-bfb0-b7eca174aa8b,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de9087-2d') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74de9087-2d, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:48 user nova-compute[73121]: INFO os_vif [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:cb:3b,bridge_name='br-int',has_traffic_filtering=True,id=74de9087-2de4-4c14-bfb0-b7eca174aa8b,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74de9087-2d')
Aug 15 02:06:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Deleting instance files /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b_del
Aug 15 02:06:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Deletion of /opt/stack/data/nova/instances/cf1d5cbe-cd2e-4a49-bde8-6e196b38994b_del complete
Aug 15 02:06:48 user nova-compute[73121]: INFO nova.compute.manager [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 15 02:06:48 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:06:48 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:06:49 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:06:49 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Took 0.49 seconds to deallocate network for instance.
Aug 15 02:06:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-d2a62971-993b-4c35-aa31-6673fcb98019 req-8fb5c277-bf5d-4734-bf8d-fc65cfa78bd7 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received event network-vif-deleted-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:06:49 user nova-compute[73121]: INFO nova.compute.manager [req-d2a62971-993b-4c35-aa31-6673fcb98019 req-8fb5c277-bf5d-4734-bf8d-fc65cfa78bd7 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Neutron deleted interface 74de9087-2de4-4c14-bfb0-b7eca174aa8b; detaching it from the instance and deleting it from the info cache
Aug 15 02:06:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-d2a62971-993b-4c35-aa31-6673fcb98019 req-8fb5c277-bf5d-4734-bf8d-fc65cfa78bd7 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:06:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-d2a62971-993b-4c35-aa31-6673fcb98019 req-8fb5c277-bf5d-4734-bf8d-fc65cfa78bd7 service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Detach interface failed, port_id=74de9087-2de4-4c14-bfb0-b7eca174aa8b, reason: Instance cf1d5cbe-cd2e-4a49-bde8-6e196b38994b could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:06:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:50 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:06:50 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:06:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.792s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:50 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Deleted allocations for instance cf1d5cbe-cd2e-4a49-bde8-6e196b38994b
Aug 15 02:06:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-56c03e30-9a92-460c-88fa-8b2e558abb85 req-bc44fdfb-63ad-4011-af43-d439d3f216ff service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received event network-vif-plugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:06:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-56c03e30-9a92-460c-88fa-8b2e558abb85 req-bc44fdfb-63ad-4011-af43-d439d3f216ff service nova] Acquiring lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:06:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-56c03e30-9a92-460c-88fa-8b2e558abb85 req-bc44fdfb-63ad-4011-af43-d439d3f216ff service nova] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:06:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-56c03e30-9a92-460c-88fa-8b2e558abb85 req-bc44fdfb-63ad-4011-af43-d439d3f216ff service nova] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-56c03e30-9a92-460c-88fa-8b2e558abb85 req-bc44fdfb-63ad-4011-af43-d439d3f216ff service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] No waiting events found dispatching network-vif-plugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:06:50 user nova-compute[73121]: WARNING nova.compute.manager [req-56c03e30-9a92-460c-88fa-8b2e558abb85 req-bc44fdfb-63ad-4011-af43-d439d3f216ff service nova] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Received unexpected event network-vif-plugged-74de9087-2de4-4c14-bfb0-b7eca174aa8b for instance with vm_state deleted and task_state None.
Aug 15 02:06:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b7ee3ec9-f80e-46a1-9fe7-266485c9e974 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "cf1d5cbe-cd2e-4a49-bde8-6e196b38994b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.496s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:06:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:06:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:06:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:06:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:06:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:06:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:06:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:00 user nova-compute[73121]: INFO nova.compute.manager [None req-7322aabc-63c2-45a5-9bb6-f4a34c89a26e tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Unrescuing
Aug 15 02:07:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7322aabc-63c2-45a5-9bb6-f4a34c89a26e tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:07:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7322aabc-63c2-45a5-9bb6-f4a34c89a26e tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquired lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:07:00 user nova-compute[73121]: DEBUG nova.network.neutron [None req-7322aabc-63c2-45a5-9bb6-f4a34c89a26e tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-7322aabc-63c2-45a5-9bb6-f4a34c89a26e tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updating instance_info_cache with network_info: [{"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7322aabc-63c2-45a5-9bb6-f4a34c89a26e tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Releasing lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7322aabc-63c2-45a5-9bb6-f4a34c89a26e tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'flavor' on Instance uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-4b3cbab0-76c1-468f-a65f-37a7b57540aa req-1c88c35c-b79f-4417-9072-a868a10aba12 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4b3cbab0-76c1-468f-a65f-37a7b57540aa req-1c88c35c-b79f-4417-9072-a868a10aba12 service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4b3cbab0-76c1-468f-a65f-37a7b57540aa req-1c88c35c-b79f-4417-9072-a868a10aba12 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4b3cbab0-76c1-468f-a65f-37a7b57540aa req-1c88c35c-b79f-4417-9072-a868a10aba12 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-4b3cbab0-76c1-468f-a65f-37a7b57540aa req-1c88c35c-b79f-4417-9072-a868a10aba12 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:01 user nova-compute[73121]: WARNING nova.compute.manager [req-4b3cbab0-76c1-468f-a65f-37a7b57540aa req-1c88c35c-b79f-4417-9072-a868a10aba12 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:07:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:01 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Instance destroyed successfully.
Aug 15 02:07:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:03 user nova-compute[73121]: WARNING nova.compute.manager [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:07:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:03 user nova-compute[73121]: WARNING nova.compute.manager [req-dfd9174b-1bbe-4b29-86dc-024ec60553c3 req-c6e130f2-5037-4c6a-acab-e35a11aaf884 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:07:03 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065208.7209456, cf1d5cbe-cd2e-4a49-bde8-6e196b38994b => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:07:03 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] VM Stopped (Lifecycle Event)
Aug 15 02:07:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8356bfaa-906b-4bfe-99e0-02f024ff9dd6 None None] [instance: cf1d5cbe-cd2e-4a49-bde8-6e196b38994b] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:04 user nova-compute[73121]: INFO nova.compute.manager [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Terminating instance
Aug 15 02:07:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Instance destroyed successfully.
Aug 15 02:07:04 user nova-compute[73121]: DEBUG nova.objects.instance [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lazy-loading 'resources' on Instance uuid 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-611731004',display_name='tempest-VolumesAdminNegativeTest-server-611731004',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-611731004',id=7,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwk5Jcd4LPk4JuNz+l9GPpuJXCXvO7nIztHcmq7yqgApWE/NAEXvtbV+u38Ix36XCp+CtYgZuaEB5W4PqNmZvxZOHYZ431RUselnnQ9I9T38+DiHBJDBMv5d2OFntyhyQ==',key_name='tempest-keypair-346632083',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cfd8c0c79b374093bfdd9fa70538769f',ramdisk_id='',reservation_id='r-mo6qzbrr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-465693716',owner_user_name='tempest-VolumesAdminNegativeTest-465693716-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ae827293f6984ad78b5361b415b78a27',uuid=1cd60a34-caf3-42b0-811d-ac93f5bc2e71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converting VIF {"id": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "address": "fa:16:3e:9e:5a:f2", "network": {"id": "5138c35f-16c8-488e-8770-89da0c4c51e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1420305449-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cfd8c0c79b374093bfdd9fa70538769f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap699f8498-cc", "ovs_interfaceid": "699f8498-cccf-4a68-ba6c-366e8ee2a959", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5a:f2,bridge_name='br-int',has_traffic_filtering=True,id=699f8498-cccf-4a68-ba6c-366e8ee2a959,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699f8498-cc') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG os_vif [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5a:f2,bridge_name='br-int',has_traffic_filtering=True,id=699f8498-cccf-4a68-ba6c-366e8ee2a959,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699f8498-cc') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap699f8498-cc, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:07:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:04 user nova-compute[73121]: INFO os_vif [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5a:f2,bridge_name='br-int',has_traffic_filtering=True,id=699f8498-cccf-4a68-ba6c-366e8ee2a959,network=Network(5138c35f-16c8-488e-8770-89da0c4c51e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap699f8498-cc')
Aug 15 02:07:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Deleting instance files /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71_del
Aug 15 02:07:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Deletion of /opt/stack/data/nova/instances/1cd60a34-caf3-42b0-811d-ac93f5bc2e71_del complete
Aug 15 02:07:05 user nova-compute[73121]: INFO nova.compute.manager [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065225.5591877, f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:07:05 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] VM Resumed (Lifecycle Event)
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-7322aabc-63c2-45a5-9bb6-f4a34c89a26e tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:07:05 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065225.5600975, f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:07:05 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] VM Started (Lifecycle Event)
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:05 user nova-compute[73121]: WARNING nova.compute.manager [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state active and task_state None.
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received event network-vif-unplugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] No waiting events found dispatching network-vif-unplugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received event network-vif-unplugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received event network-vif-plugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] Acquiring lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] No waiting events found dispatching network-vif-plugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:05 user nova-compute[73121]: WARNING nova.compute.manager [req-f73c2676-8def-4326-8e2a-9d898f7168ed req-b2c640d1-b111-42a7-b7f3-8fb56a9bbcf5 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received unexpected event network-vif-plugged-699f8498-cccf-4a68-ba6c-366e8ee2a959 for instance with vm_state active and task_state deleting.
Aug 15 02:07:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:07:06 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:06 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Took 1.36 seconds to deallocate network for instance.
Aug 15 02:07:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-431e78bf-bb46-4de3-82af-ab46600294a9 req-cecb4711-5e6f-4be2-9908-b9cd5612f8d3 service nova] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Received event network-vif-deleted-699f8498-cccf-4a68-ba6c-366e8ee2a959 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:06 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:07:06 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:07:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:06 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Deleted allocations for instance 1cd60a34-caf3-42b0-811d-ac93f5bc2e71
Aug 15 02:07:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3eb71339-1155-461d-a9df-b01abba3a54a tempest-VolumesAdminNegativeTest-465693716 tempest-VolumesAdminNegativeTest-465693716-project-member] Lock "1cd60a34-caf3-42b0-811d-ac93f5bc2e71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-caae9eb6-76b6-4819-a242-f2c49387c70f req-01cf5cf0-aaa4-4221-b2af-c5f3f8a83610 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received event network-changed-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-caae9eb6-76b6-4819-a242-f2c49387c70f req-01cf5cf0-aaa4-4221-b2af-c5f3f8a83610 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Refreshing instance network info cache due to event network-changed-078c1390-48c5-4a7f-8888-804e5ff491f7. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:07:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-caae9eb6-76b6-4819-a242-f2c49387c70f req-01cf5cf0-aaa4-4221-b2af-c5f3f8a83610 service nova] Acquiring lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:07:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-caae9eb6-76b6-4819-a242-f2c49387c70f req-01cf5cf0-aaa4-4221-b2af-c5f3f8a83610 service nova] Acquired lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:07:12 user nova-compute[73121]: DEBUG nova.network.neutron [req-caae9eb6-76b6-4819-a242-f2c49387c70f req-01cf5cf0-aaa4-4221-b2af-c5f3f8a83610 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Refreshing network info cache for port 078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:07:13 user nova-compute[73121]: DEBUG nova.network.neutron [req-caae9eb6-76b6-4819-a242-f2c49387c70f req-01cf5cf0-aaa4-4221-b2af-c5f3f8a83610 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updated VIF entry in instance network info cache for port 078c1390-48c5-4a7f-8888-804e5ff491f7. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:07:13 user nova-compute[73121]: DEBUG nova.network.neutron [req-caae9eb6-76b6-4819-a242-f2c49387c70f req-01cf5cf0-aaa4-4221-b2af-c5f3f8a83610 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updating instance_info_cache with network_info: [{"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-caae9eb6-76b6-4819-a242-f2c49387c70f req-01cf5cf0-aaa4-4221-b2af-c5f3f8a83610 service nova] Releasing lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:07:14 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:07:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:07:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-2674e20a-fa2c-48ca-aa01-bdfc0e841970 req-e498a68c-f3fa-4108-8866-bc8231e7092f service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received event network-changed-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-2674e20a-fa2c-48ca-aa01-bdfc0e841970 req-e498a68c-f3fa-4108-8866-bc8231e7092f service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Refreshing instance network info cache due to event network-changed-3ce335a5-d497-4e7a-ac6f-0e281c42cafb. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:07:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2674e20a-fa2c-48ca-aa01-bdfc0e841970 req-e498a68c-f3fa-4108-8866-bc8231e7092f service nova] Acquiring lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:07:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2674e20a-fa2c-48ca-aa01-bdfc0e841970 req-e498a68c-f3fa-4108-8866-bc8231e7092f service nova] Acquired lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:07:15 user nova-compute[73121]: DEBUG nova.network.neutron [req-2674e20a-fa2c-48ca-aa01-bdfc0e841970 req-e498a68c-f3fa-4108-8866-bc8231e7092f service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Refreshing network info cache for port 3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquiring lock "1136faf6-d177-41ae-9995-b467eb0ca92c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquiring lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:16 user nova-compute[73121]: INFO nova.compute.manager [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Terminating instance
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.network.neutron [req-2674e20a-fa2c-48ca-aa01-bdfc0e841970 req-e498a68c-f3fa-4108-8866-bc8231e7092f service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updated VIF entry in instance network info cache for port 3ce335a5-d497-4e7a-ac6f-0e281c42cafb. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.network.neutron [req-2674e20a-fa2c-48ca-aa01-bdfc0e841970 req-e498a68c-f3fa-4108-8866-bc8231e7092f service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2674e20a-fa2c-48ca-aa01-bdfc0e841970 req-e498a68c-f3fa-4108-8866-bc8231e7092f service nova] Releasing lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-f31cb95b-9f8e-4399-8318-6f3516cd64a5 req-6db42be0-7bf1-49f7-9514-1e3f7effa4f1 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received event network-vif-unplugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f31cb95b-9f8e-4399-8318-6f3516cd64a5 req-6db42be0-7bf1-49f7-9514-1e3f7effa4f1 service nova] Acquiring lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f31cb95b-9f8e-4399-8318-6f3516cd64a5 req-6db42be0-7bf1-49f7-9514-1e3f7effa4f1 service nova] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f31cb95b-9f8e-4399-8318-6f3516cd64a5 req-6db42be0-7bf1-49f7-9514-1e3f7effa4f1 service nova] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-f31cb95b-9f8e-4399-8318-6f3516cd64a5 req-6db42be0-7bf1-49f7-9514-1e3f7effa4f1 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] No waiting events found dispatching network-vif-unplugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-f31cb95b-9f8e-4399-8318-6f3516cd64a5 req-6db42be0-7bf1-49f7-9514-1e3f7effa4f1 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received event network-vif-unplugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.objects.instance [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'flavor' on Instance uuid d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating instance_info_cache with network_info: [{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:16 user nova-compute[73121]: INFO nova.compute.manager [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Attaching volume f8699a24-3ce9-4f61-9d09-71b267b78e6d to /dev/vdb
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG os_brick.utils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc22b9a-35e1-4c7a-99d4-d85d6ea34d44]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b6ca8-1f86-49a0-b245-8d717b15db41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af16c24-d637-4c98-8e85-526150a03e2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6899f0-90b1-4e67-ac27-b33200a80992]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Instance destroyed successfully.
Aug 15 02:07:17 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lazy-loading 'resources' on Instance uuid 1136faf6-d177-41ae-9995-b467eb0ca92c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:07:17 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[67900fe3-a3b3-4ed3-be08-85c306ed2eef]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG os_brick.utils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updating existing volume attachment record: 7951ab61-e59f-417e-b60a-e06abfa57a48 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:05:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-21145170',display_name='tempest-VolumesNegativeTest-instance-21145170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-21145170',id=19,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:05:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59b2f4f3b86441b48aa4aa344023c11e',ramdisk_id='',reservation_id='r-8w47aefj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1910220218',owner_user_name='tempest-VolumesNegativeTest-1910220218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:05:34Z,user_data=None,user_id='a1763d11a6a648109e8892ee67ea1e7c',uuid=1136faf6-d177-41ae-9995-b467eb0ca92c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Converting VIF {"id": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "address": "fa:16:3e:26:1b:a0", "network": {"id": "0c98637f-5dca-42aa-9675-d7a74528e027", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "455f60549c844284a91966dda1377637", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1feb94ce-e4", "ovs_interfaceid": "1feb94ce-e4fb-4aa1-a4f7-89378e9cd408", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:1b:a0,bridge_name='br-int',has_traffic_filtering=True,id=1feb94ce-e4fb-4aa1-a4f7-89378e9cd408,network=Network(0c98637f-5dca-42aa-9675-d7a74528e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feb94ce-e4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG os_vif [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:1b:a0,bridge_name='br-int',has_traffic_filtering=True,id=1feb94ce-e4fb-4aa1-a4f7-89378e9cd408,network=Network(0c98637f-5dca-42aa-9675-d7a74528e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feb94ce-e4') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1feb94ce-e4, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:17 user nova-compute[73121]: INFO os_vif [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:1b:a0,bridge_name='br-int',has_traffic_filtering=True,id=1feb94ce-e4fb-4aa1-a4f7-89378e9cd408,network=Network(0c98637f-5dca-42aa-9675-d7a74528e027),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1feb94ce-e4')
Aug 15 02:07:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Deleting instance files /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c_del
Aug 15 02:07:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Deletion of /opt/stack/data/nova/instances/1136faf6-d177-41ae-9995-b467eb0ca92c_del complete
Aug 15 02:07:17 user nova-compute[73121]: INFO nova.compute.manager [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 15 02:07:17 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:07:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:18 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Took 0.90 seconds to deallocate network for instance.
Aug 15 02:07:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-89d577fa-956e-4b9d-9970-3db63977f32e req-f1bf99ce-8a3e-4ce0-a2ad-4b34bc57f129 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received event network-vif-deleted-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:18 user nova-compute[73121]: INFO nova.compute.manager [req-89d577fa-956e-4b9d-9970-3db63977f32e req-f1bf99ce-8a3e-4ce0-a2ad-4b34bc57f129 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Neutron deleted interface 1feb94ce-e4fb-4aa1-a4f7-89378e9cd408; detaching it from the instance and deleting it from the info cache
Aug 15 02:07:18 user nova-compute[73121]: DEBUG nova.network.neutron [req-89d577fa-956e-4b9d-9970-3db63977f32e req-f1bf99ce-8a3e-4ce0-a2ad-4b34bc57f129 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-89d577fa-956e-4b9d-9970-3db63977f32e req-f1bf99ce-8a3e-4ce0-a2ad-4b34bc57f129 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Detach interface failed, port_id=1feb94ce-e4fb-4aa1-a4f7-89378e9cd408, reason: Instance 1136faf6-d177-41ae-9995-b467eb0ca92c could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:18 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Deleted allocations for instance 1136faf6-d177-41ae-9995-b467eb0ca92c
Aug 15 02:07:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f6d628e-7ba6-48d4-a9bf-9df3ddabe6d9 tempest-VolumesNegativeTest-1910220218 tempest-VolumesNegativeTest-1910220218-project-member] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.357s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-57f222f0-39d3-4d3b-986b-6b3dc4e1c06e req-5e8b7ce3-a41a-4775-916c-6d6946732142 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received event network-vif-plugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-57f222f0-39d3-4d3b-986b-6b3dc4e1c06e req-5e8b7ce3-a41a-4775-916c-6d6946732142 service nova] Acquiring lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-57f222f0-39d3-4d3b-986b-6b3dc4e1c06e req-5e8b7ce3-a41a-4775-916c-6d6946732142 service nova] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-57f222f0-39d3-4d3b-986b-6b3dc4e1c06e req-5e8b7ce3-a41a-4775-916c-6d6946732142 service nova] Lock "1136faf6-d177-41ae-9995-b467eb0ca92c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-57f222f0-39d3-4d3b-986b-6b3dc4e1c06e req-5e8b7ce3-a41a-4775-916c-6d6946732142 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] No waiting events found dispatching network-vif-plugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:18 user nova-compute[73121]: WARNING nova.compute.manager [req-57f222f0-39d3-4d3b-986b-6b3dc4e1c06e req-5e8b7ce3-a41a-4775-916c-6d6946732142 service nova] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Received unexpected event network-vif-plugged-1feb94ce-e4fb-4aa1-a4f7-89378e9cd408 for instance with vm_state deleted and task_state None.
Aug 15 02:07:19 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:07:19 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065224.9192185, 1cd60a34-caf3-42b0-811d-ac93f5bc2e71 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:07:19 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] VM Stopped (Lifecycle Event)
Aug 15 02:07:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-54d6a5e4-51b8-4e87-a110-419acf1f00d0 None None] [instance: 1cd60a34-caf3-42b0-811d-ac93f5bc2e71] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:22 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:07:22 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:07:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7994MB free_disk=25.578784942626953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 4e04a498-4518-46c9-bc49-4d0d5d6aa054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:07:22 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:07:23 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:07:23 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:07:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:07:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.392s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jETIVpHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:07:25 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:07:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:07:25 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:07:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:07:25 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:07:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[00746b95-7e29-4769-9ed5-c21a8d55727c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:07:25 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d813e0-603a-4016-bcf5-b5eaf4ae0ec2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d] added
Aug 15 02:07:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[112985b9-77fd-41b8-bede-3bc4da4934e6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c05836-e884-41cc-9dc0-70283316a869]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jETIVpHx {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jETIVpHx" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[507d9386-b6cd-4fc0-90cb-b496a64e148a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jETIVpHx'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b76364a-4859-43e3-8eac-6d8e38835e6f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4946a6a9-592f-4521-bbbf-ded43eb3117d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:07:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:07:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fe0094-3059-40c0-85a1-6d1ed31084dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d, portal: 172.16.0.220,3260]
Aug 15 02:07:26 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d, portal: 172.16.0.220,3260] successful.
Aug 15 02:07:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdfc30b-8e24-46a2-a5e7-435391e413f4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b826944d-509d-4c12-b8e2-41965dcb45b2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:07:26 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:07:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:07:26 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:07:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[050b8ae9-a719-4bb9-a868-c2bec85c78ea]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:07:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jETIVpHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23565376333636137', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565376333636137', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG nova.objects.instance [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'flavor' on Instance uuid d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:07:27 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:07:27 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:07:27 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:07:27 user nova-compute[73121]:   <serial>f8699a24-3ce9-4f61-9d09-71b267b78e6d</serial>
Aug 15 02:07:27 user nova-compute[73121]: </disk>
Aug 15 02:07:27 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No VIF found with MAC fa:16:3e:2f:4a:cf, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:07:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-40ae0ec6-b142-411d-80cf-537075490ffa tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.931s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "74145868-6dc5-4e1a-be20-80c6cfe659db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:07:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:31 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:07:31 user nova-compute[73121]: INFO nova.compute.claims [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Claim successful on node user
Aug 15 02:07:31 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:07:31 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:07:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:07:32 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065237.0443509, 1136faf6-d177-41ae-9995-b467eb0ca92c => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:07:32 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] VM Stopped (Lifecycle Event)
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-154f0828-5ec7-471b-8e14-906dc34f0192 None None] [instance: 1136faf6-d177-41ae-9995-b467eb0ca92c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.policy [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c1e20e779ac4711803956ee2a2accaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc744b107dc4a8baa3274788b094e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:07:32 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Creating image(s)
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "/opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "/opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "/opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk 1073741824" returned: 0 in 0.055s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Successfully created port: 624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Cannot resize image /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG nova.objects.instance [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'migration_context' on Instance uuid 74145868-6dc5-4e1a-be20-80c6cfe659db {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Ensure instance console log exists: /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Successfully updated port: 624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "refresh_cache-74145868-6dc5-4e1a-be20-80c6cfe659db" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquired lock "refresh_cache-74145868-6dc5-4e1a-be20-80c6cfe659db" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-c55c424d-b797-4e4a-a813-9076d2b4a957 req-2ac57c51-6c51-45f3-a9e5-df8246edec85 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received event network-changed-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-c55c424d-b797-4e4a-a813-9076d2b4a957 req-2ac57c51-6c51-45f3-a9e5-df8246edec85 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Refreshing instance network info cache due to event network-changed-624d78ac-3c50-4113-9b04-b3c96b50d521. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c55c424d-b797-4e4a-a813-9076d2b4a957 req-2ac57c51-6c51-45f3-a9e5-df8246edec85 service nova] Acquiring lock "refresh_cache-74145868-6dc5-4e1a-be20-80c6cfe659db" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:07:33 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Updating instance_info_cache with network_info: [{"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Releasing lock "refresh_cache-74145868-6dc5-4e1a-be20-80c6cfe659db" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Instance network_info: |[{"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c55c424d-b797-4e4a-a813-9076d2b4a957 req-2ac57c51-6c51-45f3-a9e5-df8246edec85 service nova] Acquired lock "refresh_cache-74145868-6dc5-4e1a-be20-80c6cfe659db" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-c55c424d-b797-4e4a-a813-9076d2b4a957 req-2ac57c51-6c51-45f3-a9e5-df8246edec85 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Refreshing network info cache for port 624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Start _get_guest_xml network_info=[{"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:07:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:07:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-646150611',display_name='tempest-AttachVolumeNegativeTest-server-646150611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-646150611',id=20,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSlhvISeozWVHlWR1ZzRg1V26ieyjbph3s6lgo+sd7tXYT6u1t+txu8qou0DZO6HryztS2G6E9/idYvAZ/UMpPPrVadqbYOxMsuV2V9hSkq3crk5fBNAMXJtkYfTsEXQg==',key_name='tempest-keypair-511685617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-eq9kh2hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=74145868-6dc5-4e1a-be20-80c6cfe659db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:89:ba,bridge_name='br-int',has_traffic_filtering=True,id=624d78ac-3c50-4113-9b04-b3c96b50d521,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624d78ac-3c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.objects.instance [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'pci_devices' on Instance uuid 74145868-6dc5-4e1a-be20-80c6cfe659db {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:07:34 user nova-compute[73121]:   <uuid>74145868-6dc5-4e1a-be20-80c6cfe659db</uuid>
Aug 15 02:07:34 user nova-compute[73121]:   <name>instance-00000014</name>
Aug 15 02:07:34 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:07:34 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:07:34 user nova-compute[73121]:   <metadata>
Aug 15 02:07:34 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:07:34 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:07:34 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeNegativeTest-server-646150611</nova:name>
Aug 15 02:07:34 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:07:34</nova:creationTime>
Aug 15 02:07:34 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:07:34 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:07:34 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:07:34 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:07:34 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:07:34 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:07:34 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:07:34 user nova-compute[73121]:       <nova:owner>
Aug 15 02:07:34 user nova-compute[73121]:         <nova:user uuid="5c1e20e779ac4711803956ee2a2accaa">tempest-AttachVolumeNegativeTest-2069847524-project-member</nova:user>
Aug 15 02:07:34 user nova-compute[73121]:         <nova:project uuid="fcc744b107dc4a8baa3274788b094e2d">tempest-AttachVolumeNegativeTest-2069847524</nova:project>
Aug 15 02:07:34 user nova-compute[73121]:       </nova:owner>
Aug 15 02:07:34 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:07:34 user nova-compute[73121]:       <nova:ports>
Aug 15 02:07:34 user nova-compute[73121]:         <nova:port uuid="624d78ac-3c50-4113-9b04-b3c96b50d521">
Aug 15 02:07:34 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:07:34 user nova-compute[73121]:         </nova:port>
Aug 15 02:07:34 user nova-compute[73121]:       </nova:ports>
Aug 15 02:07:34 user nova-compute[73121]:     </nova:instance>
Aug 15 02:07:34 user nova-compute[73121]:   </metadata>
Aug 15 02:07:34 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:07:34 user nova-compute[73121]:     <system>
Aug 15 02:07:34 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:07:34 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:07:34 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:07:34 user nova-compute[73121]:       <entry name="serial">74145868-6dc5-4e1a-be20-80c6cfe659db</entry>
Aug 15 02:07:34 user nova-compute[73121]:       <entry name="uuid">74145868-6dc5-4e1a-be20-80c6cfe659db</entry>
Aug 15 02:07:34 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:07:34 user nova-compute[73121]:     </system>
Aug 15 02:07:34 user nova-compute[73121]:   </sysinfo>
Aug 15 02:07:34 user nova-compute[73121]:   <os>
Aug 15 02:07:34 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:07:34 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:07:34 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:07:34 user nova-compute[73121]:   </os>
Aug 15 02:07:34 user nova-compute[73121]:   <features>
Aug 15 02:07:34 user nova-compute[73121]:     <acpi/>
Aug 15 02:07:34 user nova-compute[73121]:     <apic/>
Aug 15 02:07:34 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:07:34 user nova-compute[73121]:   </features>
Aug 15 02:07:34 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:07:34 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:07:34 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:07:34 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:07:34 user nova-compute[73121]:   </clock>
Aug 15 02:07:34 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:07:34 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:07:34 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:07:34 user nova-compute[73121]:   </cpu>
Aug 15 02:07:34 user nova-compute[73121]:   <devices>
Aug 15 02:07:34 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:07:34 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:07:34 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk"/>
Aug 15 02:07:34 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:07:34 user nova-compute[73121]:     </disk>
Aug 15 02:07:34 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:07:34 user nova-compute[73121]:       <mac address="fa:16:3e:41:89:ba"/>
Aug 15 02:07:34 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:07:34 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:07:34 user nova-compute[73121]:       <target dev="tap624d78ac-3c"/>
Aug 15 02:07:34 user nova-compute[73121]:     </interface>
Aug 15 02:07:34 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:07:34 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/console.log" append="off"/>
Aug 15 02:07:34 user nova-compute[73121]:     </serial>
Aug 15 02:07:34 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:07:34 user nova-compute[73121]:     <video>
Aug 15 02:07:34 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:07:34 user nova-compute[73121]:     </video>
Aug 15 02:07:34 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:07:34 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:07:34 user nova-compute[73121]:     </rng>
Aug 15 02:07:34 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:07:34 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:07:34 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:07:34 user nova-compute[73121]:     </memballoon>
Aug 15 02:07:34 user nova-compute[73121]:   </devices>
Aug 15 02:07:34 user nova-compute[73121]: </domain>
Aug 15 02:07:34 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-646150611',display_name='tempest-AttachVolumeNegativeTest-server-646150611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-646150611',id=20,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSlhvISeozWVHlWR1ZzRg1V26ieyjbph3s6lgo+sd7tXYT6u1t+txu8qou0DZO6HryztS2G6E9/idYvAZ/UMpPPrVadqbYOxMsuV2V9hSkq3crk5fBNAMXJtkYfTsEXQg==',key_name='tempest-keypair-511685617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-eq9kh2hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=74145868-6dc5-4e1a-be20-80c6cfe659db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:89:ba,bridge_name='br-int',has_traffic_filtering=True,id=624d78ac-3c50-4113-9b04-b3c96b50d521,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624d78ac-3c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG os_vif [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:89:ba,bridge_name='br-int',has_traffic_filtering=True,id=624d78ac-3c50-4113-9b04-b3c96b50d521,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624d78ac-3c') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap624d78ac-3c, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap624d78ac-3c, col_values=(('external_ids', {'iface-id': '624d78ac-3c50-4113-9b04-b3c96b50d521', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:89:ba', 'vm-uuid': '74145868-6dc5-4e1a-be20-80c6cfe659db'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:34 user nova-compute[73121]: INFO os_vif [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:89:ba,bridge_name='br-int',has_traffic_filtering=True,id=624d78ac-3c50-4113-9b04-b3c96b50d521,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624d78ac-3c')
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No VIF found with MAC fa:16:3e:41:89:ba, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-c55c424d-b797-4e4a-a813-9076d2b4a957 req-2ac57c51-6c51-45f3-a9e5-df8246edec85 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Updated VIF entry in instance network info cache for port 624d78ac-3c50-4113-9b04-b3c96b50d521. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-c55c424d-b797-4e4a-a813-9076d2b4a957 req-2ac57c51-6c51-45f3-a9e5-df8246edec85 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Updating instance_info_cache with network_info: [{"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c55c424d-b797-4e4a-a813-9076d2b4a957 req-2ac57c51-6c51-45f3-a9e5-df8246edec85 service nova] Releasing lock "refresh_cache-74145868-6dc5-4e1a-be20-80c6cfe659db" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG nova.compute.manager [req-264d0ea7-5173-49ae-9768-38dc5ee24bed req-509f32c7-8c5a-4da2-b8d6-b1eb9e214dd8 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received event network-vif-plugged-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-264d0ea7-5173-49ae-9768-38dc5ee24bed req-509f32c7-8c5a-4da2-b8d6-b1eb9e214dd8 service nova] Acquiring lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-264d0ea7-5173-49ae-9768-38dc5ee24bed req-509f32c7-8c5a-4da2-b8d6-b1eb9e214dd8 service nova] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-264d0ea7-5173-49ae-9768-38dc5ee24bed req-509f32c7-8c5a-4da2-b8d6-b1eb9e214dd8 service nova] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:35 user nova-compute[73121]: DEBUG nova.compute.manager [req-264d0ea7-5173-49ae-9768-38dc5ee24bed req-509f32c7-8c5a-4da2-b8d6-b1eb9e214dd8 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] No waiting events found dispatching network-vif-plugged-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:35 user nova-compute[73121]: WARNING nova.compute.manager [req-264d0ea7-5173-49ae-9768-38dc5ee24bed req-509f32c7-8c5a-4da2-b8d6-b1eb9e214dd8 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received unexpected event network-vif-plugged-624d78ac-3c50-4113-9b04-b3c96b50d521 for instance with vm_state building and task_state spawning.
Aug 15 02:07:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065257.807437, 74145868-6dc5-4e1a-be20-80c6cfe659db => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:07:37 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] VM Resumed (Lifecycle Event)
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:07:37 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Instance spawned successfully.
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:37 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065257.8086674, 74145868-6dc5-4e1a-be20-80c6cfe659db => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:07:37 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] VM Started (Lifecycle Event)
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:07:37 user nova-compute[73121]: INFO nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Took 5.73 seconds to spawn the instance on the hypervisor.
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:37 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.compute.manager [req-6aae6097-f32e-4dc2-b9ab-d3fb7c10d01a req-38d5d5ab-db91-44ff-9513-87195d01383d service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received event network-vif-plugged-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6aae6097-f32e-4dc2-b9ab-d3fb7c10d01a req-38d5d5ab-db91-44ff-9513-87195d01383d service nova] Acquiring lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6aae6097-f32e-4dc2-b9ab-d3fb7c10d01a req-38d5d5ab-db91-44ff-9513-87195d01383d service nova] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6aae6097-f32e-4dc2-b9ab-d3fb7c10d01a req-38d5d5ab-db91-44ff-9513-87195d01383d service nova] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:37 user nova-compute[73121]: DEBUG nova.compute.manager [req-6aae6097-f32e-4dc2-b9ab-d3fb7c10d01a req-38d5d5ab-db91-44ff-9513-87195d01383d service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] No waiting events found dispatching network-vif-plugged-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:37 user nova-compute[73121]: WARNING nova.compute.manager [req-6aae6097-f32e-4dc2-b9ab-d3fb7c10d01a req-38d5d5ab-db91-44ff-9513-87195d01383d service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received unexpected event network-vif-plugged-624d78ac-3c50-4113-9b04-b3c96b50d521 for instance with vm_state building and task_state spawning.
Aug 15 02:07:38 user nova-compute[73121]: INFO nova.compute.manager [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Took 6.43 seconds to build instance.
Aug 15 02:07:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15400ad6-8e2d-47a0-8cb8-d87165363877 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.549s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:07:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:39 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:07:39 user nova-compute[73121]: INFO nova.compute.claims [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Claim successful on node user
Aug 15 02:07:40 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:07:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:07:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG nova.policy [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4c4cfb8a12443a4925a3f8d0814abd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65be7e8458ae4063b08bdf6cca18f36e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:07:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Creating image(s)
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "/opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "/opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "/opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk 1073741824" returned: 0 in 0.060s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.197s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Successfully created port: 22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Cannot resize image /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lazy-loading 'migration_context' on Instance uuid b33dfac8-fd6d-4954-a7a8-632dbbca1304 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Ensure instance console log exists: /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Successfully updated port: 22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "refresh_cache-b33dfac8-fd6d-4954-a7a8-632dbbca1304" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquired lock "refresh_cache-b33dfac8-fd6d-4954-a7a8-632dbbca1304" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-98d3130f-c134-408a-aa7a-c557f6811c3a req-84927748-6cf7-4920-a783-a5c0398b4ce7 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received event network-changed-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-98d3130f-c134-408a-aa7a-c557f6811c3a req-84927748-6cf7-4920-a783-a5c0398b4ce7 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Refreshing instance network info cache due to event network-changed-22052ee1-246a-432e-aedf-2e44fbef2098. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-98d3130f-c134-408a-aa7a-c557f6811c3a req-84927748-6cf7-4920-a783-a5c0398b4ce7 service nova] Acquiring lock "refresh_cache-b33dfac8-fd6d-4954-a7a8-632dbbca1304" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Updating instance_info_cache with network_info: [{"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Releasing lock "refresh_cache-b33dfac8-fd6d-4954-a7a8-632dbbca1304" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Instance network_info: |[{"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-98d3130f-c134-408a-aa7a-c557f6811c3a req-84927748-6cf7-4920-a783-a5c0398b4ce7 service nova] Acquired lock "refresh_cache-b33dfac8-fd6d-4954-a7a8-632dbbca1304" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.network.neutron [req-98d3130f-c134-408a-aa7a-c557f6811c3a req-84927748-6cf7-4920-a783-a5c0398b4ce7 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Refreshing network info cache for port 22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Start _get_guest_xml network_info=[{"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:07:42 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:07:42 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1699823232',display_name='tempest-VolumesActionsTest-instance-1699823232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1699823232',id=21,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65be7e8458ae4063b08bdf6cca18f36e',ramdisk_id='',reservation_id='r-72q0vwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-469015841',owner_user_name='tempest-VolumesActionsTest-469015841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:07:40Z,user_data=None,user_id='c4c4cfb8a12443a4925a3f8d0814abd8',uuid=b33dfac8-fd6d-4954-a7a8-632dbbca1304,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converting VIF {"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:b6:e5,bridge_name='br-int',has_traffic_filtering=True,id=22052ee1-246a-432e-aedf-2e44fbef2098,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22052ee1-24') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lazy-loading 'pci_devices' on Instance uuid b33dfac8-fd6d-4954-a7a8-632dbbca1304 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:07:42 user nova-compute[73121]:   <uuid>b33dfac8-fd6d-4954-a7a8-632dbbca1304</uuid>
Aug 15 02:07:42 user nova-compute[73121]:   <name>instance-00000015</name>
Aug 15 02:07:42 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:07:42 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:07:42 user nova-compute[73121]:   <metadata>
Aug 15 02:07:42 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:07:42 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:07:42 user nova-compute[73121]:       <nova:name>tempest-VolumesActionsTest-instance-1699823232</nova:name>
Aug 15 02:07:42 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:07:42</nova:creationTime>
Aug 15 02:07:42 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:07:42 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:07:42 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:07:42 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:07:42 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:07:42 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:07:42 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:07:42 user nova-compute[73121]:       <nova:owner>
Aug 15 02:07:42 user nova-compute[73121]:         <nova:user uuid="c4c4cfb8a12443a4925a3f8d0814abd8">tempest-VolumesActionsTest-469015841-project-member</nova:user>
Aug 15 02:07:42 user nova-compute[73121]:         <nova:project uuid="65be7e8458ae4063b08bdf6cca18f36e">tempest-VolumesActionsTest-469015841</nova:project>
Aug 15 02:07:42 user nova-compute[73121]:       </nova:owner>
Aug 15 02:07:42 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:07:42 user nova-compute[73121]:       <nova:ports>
Aug 15 02:07:42 user nova-compute[73121]:         <nova:port uuid="22052ee1-246a-432e-aedf-2e44fbef2098">
Aug 15 02:07:42 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 02:07:42 user nova-compute[73121]:         </nova:port>
Aug 15 02:07:42 user nova-compute[73121]:       </nova:ports>
Aug 15 02:07:42 user nova-compute[73121]:     </nova:instance>
Aug 15 02:07:42 user nova-compute[73121]:   </metadata>
Aug 15 02:07:42 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:07:42 user nova-compute[73121]:     <system>
Aug 15 02:07:42 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:07:42 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:07:42 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:07:42 user nova-compute[73121]:       <entry name="serial">b33dfac8-fd6d-4954-a7a8-632dbbca1304</entry>
Aug 15 02:07:42 user nova-compute[73121]:       <entry name="uuid">b33dfac8-fd6d-4954-a7a8-632dbbca1304</entry>
Aug 15 02:07:42 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:07:42 user nova-compute[73121]:     </system>
Aug 15 02:07:42 user nova-compute[73121]:   </sysinfo>
Aug 15 02:07:42 user nova-compute[73121]:   <os>
Aug 15 02:07:42 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:07:42 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:07:42 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:07:42 user nova-compute[73121]:   </os>
Aug 15 02:07:42 user nova-compute[73121]:   <features>
Aug 15 02:07:42 user nova-compute[73121]:     <acpi/>
Aug 15 02:07:42 user nova-compute[73121]:     <apic/>
Aug 15 02:07:42 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:07:42 user nova-compute[73121]:   </features>
Aug 15 02:07:42 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:07:42 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:07:42 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:07:42 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:07:42 user nova-compute[73121]:   </clock>
Aug 15 02:07:42 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:07:42 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:07:42 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:07:42 user nova-compute[73121]:   </cpu>
Aug 15 02:07:42 user nova-compute[73121]:   <devices>
Aug 15 02:07:42 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:07:42 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:07:42 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk"/>
Aug 15 02:07:42 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:07:42 user nova-compute[73121]:     </disk>
Aug 15 02:07:42 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:07:42 user nova-compute[73121]:       <mac address="fa:16:3e:6a:b6:e5"/>
Aug 15 02:07:42 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:07:42 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:07:42 user nova-compute[73121]:       <target dev="tap22052ee1-24"/>
Aug 15 02:07:42 user nova-compute[73121]:     </interface>
Aug 15 02:07:42 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:07:42 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/console.log" append="off"/>
Aug 15 02:07:42 user nova-compute[73121]:     </serial>
Aug 15 02:07:42 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:07:42 user nova-compute[73121]:     <video>
Aug 15 02:07:42 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:07:42 user nova-compute[73121]:     </video>
Aug 15 02:07:42 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:07:42 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:07:42 user nova-compute[73121]:     </rng>
Aug 15 02:07:42 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:07:42 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:07:42 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:07:42 user nova-compute[73121]:     </memballoon>
Aug 15 02:07:42 user nova-compute[73121]:   </devices>
Aug 15 02:07:42 user nova-compute[73121]: </domain>
Aug 15 02:07:42 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1699823232',display_name='tempest-VolumesActionsTest-instance-1699823232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1699823232',id=21,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='65be7e8458ae4063b08bdf6cca18f36e',ramdisk_id='',reservation_id='r-72q0vwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-469015841',owner_user_name='tempest-VolumesActionsTest-469015841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:07:40Z,user_data=None,user_id='c4c4cfb8a12443a4925a3f8d0814abd8',uuid=b33dfac8-fd6d-4954-a7a8-632dbbca1304,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converting VIF {"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:b6:e5,bridge_name='br-int',has_traffic_filtering=True,id=22052ee1-246a-432e-aedf-2e44fbef2098,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22052ee1-24') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG os_vif [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:b6:e5,bridge_name='br-int',has_traffic_filtering=True,id=22052ee1-246a-432e-aedf-2e44fbef2098,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22052ee1-24') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22052ee1-24, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22052ee1-24, col_values=(('external_ids', {'iface-id': '22052ee1-246a-432e-aedf-2e44fbef2098', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:b6:e5', 'vm-uuid': 'b33dfac8-fd6d-4954-a7a8-632dbbca1304'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:42 user nova-compute[73121]: INFO os_vif [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:b6:e5,bridge_name='br-int',has_traffic_filtering=True,id=22052ee1-246a-432e-aedf-2e44fbef2098,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22052ee1-24')
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:07:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] No VIF found with MAC fa:16:3e:6a:b6:e5, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:07:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-98d3130f-c134-408a-aa7a-c557f6811c3a req-84927748-6cf7-4920-a783-a5c0398b4ce7 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Updated VIF entry in instance network info cache for port 22052ee1-246a-432e-aedf-2e44fbef2098. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:07:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-98d3130f-c134-408a-aa7a-c557f6811c3a req-84927748-6cf7-4920-a783-a5c0398b4ce7 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Updating instance_info_cache with network_info: [{"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:07:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-98d3130f-c134-408a-aa7a-c557f6811c3a req-84927748-6cf7-4920-a783-a5c0398b4ce7 service nova] Releasing lock "refresh_cache-b33dfac8-fd6d-4954-a7a8-632dbbca1304" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:07:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-a46e7cda-a275-4675-8bc8-fd0c7ddc02c0 req-6b50e896-a4f1-470b-b5b4-8db0f9fb0497 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received event network-vif-plugged-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a46e7cda-a275-4675-8bc8-fd0c7ddc02c0 req-6b50e896-a4f1-470b-b5b4-8db0f9fb0497 service nova] Acquiring lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a46e7cda-a275-4675-8bc8-fd0c7ddc02c0 req-6b50e896-a4f1-470b-b5b4-8db0f9fb0497 service nova] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a46e7cda-a275-4675-8bc8-fd0c7ddc02c0 req-6b50e896-a4f1-470b-b5b4-8db0f9fb0497 service nova] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-a46e7cda-a275-4675-8bc8-fd0c7ddc02c0 req-6b50e896-a4f1-470b-b5b4-8db0f9fb0497 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] No waiting events found dispatching network-vif-plugged-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:44 user nova-compute[73121]: WARNING nova.compute.manager [req-a46e7cda-a275-4675-8bc8-fd0c7ddc02c0 req-6b50e896-a4f1-470b-b5b4-8db0f9fb0497 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received unexpected event network-vif-plugged-22052ee1-246a-432e-aedf-2e44fbef2098 for instance with vm_state building and task_state spawning.
Aug 15 02:07:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-53454450-10e2-4ad2-a08a-95a385c8af8b req-3885a8ff-ccb1-4921-b4b5-7d718599d2a2 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received event network-vif-plugged-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-53454450-10e2-4ad2-a08a-95a385c8af8b req-3885a8ff-ccb1-4921-b4b5-7d718599d2a2 service nova] Acquiring lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-53454450-10e2-4ad2-a08a-95a385c8af8b req-3885a8ff-ccb1-4921-b4b5-7d718599d2a2 service nova] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-53454450-10e2-4ad2-a08a-95a385c8af8b req-3885a8ff-ccb1-4921-b4b5-7d718599d2a2 service nova] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-53454450-10e2-4ad2-a08a-95a385c8af8b req-3885a8ff-ccb1-4921-b4b5-7d718599d2a2 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] No waiting events found dispatching network-vif-plugged-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:07:46 user nova-compute[73121]: WARNING nova.compute.manager [req-53454450-10e2-4ad2-a08a-95a385c8af8b req-3885a8ff-ccb1-4921-b4b5-7d718599d2a2 service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received unexpected event network-vif-plugged-22052ee1-246a-432e-aedf-2e44fbef2098 for instance with vm_state building and task_state spawning.
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065266.7282743, b33dfac8-fd6d-4954-a7a8-632dbbca1304 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:07:46 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] VM Resumed (Lifecycle Event)
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:07:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Instance spawned successfully.
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:07:46 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065266.7322679, b33dfac8-fd6d-4954-a7a8-632dbbca1304 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:07:46 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] VM Started (Lifecycle Event)
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:07:46 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:07:46 user nova-compute[73121]: INFO nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 15 02:07:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:07:46 user nova-compute[73121]: INFO nova.compute.manager [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Took 7.28 seconds to build instance.
Aug 15 02:07:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f1c35205-b304-41d7-a9c7-1d48b2fa7ca0 tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.406s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:07:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:07:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquired lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.network.neutron [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'info_cache' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.network.neutron [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating instance_info_cache with network_info: [{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Releasing lock "refresh_cache-2c215d73-ebab-4b74-b2a5-a4b5a0264e89" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:08:09 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance destroyed successfully.
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'resources' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-696601170',display_name='tempest-AttachVolumeTestJSON-server-696601170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-696601170',id=2,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrHjZP720UW0jo4iit8Pxgel5e+QfHyvMcWZQXiEzUPxi1x+UpLbvVaMujS5PIKUKWw85w6Ks98+VVNHxofUs5EqHpLoyaS82dHgB23+nlXLdzYmwP/5iI0jRjGfKXxQ==',key_name='tempest-keypair-65630828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-xc2jvcst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=2c215d73-ebab-4b74-b2a5-a4b5a0264e89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG os_vif [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap896acc02-dd, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:08:09 user nova-compute[73121]: INFO os_vif [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd')
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Start _get_guest_xml network_info=[{"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'numa_topology' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:09 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:09 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-696601170',display_name='tempest-AttachVolumeTestJSON-server-696601170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-696601170',id=2,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrHjZP720UW0jo4iit8Pxgel5e+QfHyvMcWZQXiEzUPxi1x+UpLbvVaMujS5PIKUKWw85w6Ks98+VVNHxofUs5EqHpLoyaS82dHgB23+nlXLdzYmwP/5iI0jRjGfKXxQ==',key_name='tempest-keypair-65630828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-xc2jvcst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=2c215d73-ebab-4b74-b2a5-a4b5a0264e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:08:09 user nova-compute[73121]:   <uuid>2c215d73-ebab-4b74-b2a5-a4b5a0264e89</uuid>
Aug 15 02:08:09 user nova-compute[73121]:   <name>instance-00000002</name>
Aug 15 02:08:09 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:08:09 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:08:09 user nova-compute[73121]:   <metadata>
Aug 15 02:08:09 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:08:09 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:08:09 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeTestJSON-server-696601170</nova:name>
Aug 15 02:08:09 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:08:09</nova:creationTime>
Aug 15 02:08:09 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:08:09 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:08:09 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:08:09 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:08:09 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:08:09 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:08:09 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:08:09 user nova-compute[73121]:       <nova:owner>
Aug 15 02:08:09 user nova-compute[73121]:         <nova:user uuid="8c555808f8b84962b88920df9f029648">tempest-AttachVolumeTestJSON-1774938081-project-member</nova:user>
Aug 15 02:08:09 user nova-compute[73121]:         <nova:project uuid="16eb9362b3cd4011b8c7bae927a6edd6">tempest-AttachVolumeTestJSON-1774938081</nova:project>
Aug 15 02:08:09 user nova-compute[73121]:       </nova:owner>
Aug 15 02:08:09 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:08:09 user nova-compute[73121]:       <nova:ports>
Aug 15 02:08:09 user nova-compute[73121]:         <nova:port uuid="896acc02-dd7e-4464-be83-5a9774c03d22">
Aug 15 02:08:09 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 02:08:09 user nova-compute[73121]:         </nova:port>
Aug 15 02:08:09 user nova-compute[73121]:       </nova:ports>
Aug 15 02:08:09 user nova-compute[73121]:     </nova:instance>
Aug 15 02:08:09 user nova-compute[73121]:   </metadata>
Aug 15 02:08:09 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:08:09 user nova-compute[73121]:     <system>
Aug 15 02:08:09 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:08:09 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:08:09 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:08:09 user nova-compute[73121]:       <entry name="serial">2c215d73-ebab-4b74-b2a5-a4b5a0264e89</entry>
Aug 15 02:08:09 user nova-compute[73121]:       <entry name="uuid">2c215d73-ebab-4b74-b2a5-a4b5a0264e89</entry>
Aug 15 02:08:09 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:08:09 user nova-compute[73121]:     </system>
Aug 15 02:08:09 user nova-compute[73121]:   </sysinfo>
Aug 15 02:08:09 user nova-compute[73121]:   <os>
Aug 15 02:08:09 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:08:09 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:08:09 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:08:09 user nova-compute[73121]:   </os>
Aug 15 02:08:09 user nova-compute[73121]:   <features>
Aug 15 02:08:09 user nova-compute[73121]:     <acpi/>
Aug 15 02:08:09 user nova-compute[73121]:     <apic/>
Aug 15 02:08:09 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:08:09 user nova-compute[73121]:   </features>
Aug 15 02:08:09 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:08:09 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:08:09 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:08:09 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:08:09 user nova-compute[73121]:   </clock>
Aug 15 02:08:09 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:08:09 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:08:09 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:08:09 user nova-compute[73121]:   </cpu>
Aug 15 02:08:09 user nova-compute[73121]:   <devices>
Aug 15 02:08:09 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:08:09 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:08:09 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk"/>
Aug 15 02:08:09 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:08:09 user nova-compute[73121]:     </disk>
Aug 15 02:08:09 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:08:09 user nova-compute[73121]:       <mac address="fa:16:3e:a5:cc:77"/>
Aug 15 02:08:09 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:08:09 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:08:09 user nova-compute[73121]:       <target dev="tap896acc02-dd"/>
Aug 15 02:08:09 user nova-compute[73121]:     </interface>
Aug 15 02:08:09 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:08:09 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/console.log" append="off"/>
Aug 15 02:08:09 user nova-compute[73121]:     </serial>
Aug 15 02:08:09 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:08:09 user nova-compute[73121]:     <video>
Aug 15 02:08:09 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:08:09 user nova-compute[73121]:     </video>
Aug 15 02:08:09 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:08:09 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:08:09 user nova-compute[73121]:     </rng>
Aug 15 02:08:09 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:08:09 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:08:09 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:08:09 user nova-compute[73121]:     </memballoon>
Aug 15 02:08:09 user nova-compute[73121]:   </devices>
Aug 15 02:08:09 user nova-compute[73121]: </domain>
Aug 15 02:08:09 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:08:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.215s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Cannot resize image /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'migration_context' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-696601170',display_name='tempest-AttachVolumeTestJSON-server-696601170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-696601170',id=2,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrHjZP720UW0jo4iit8Pxgel5e+QfHyvMcWZQXiEzUPxi1x+UpLbvVaMujS5PIKUKWw85w6Ks98+VVNHxofUs5EqHpLoyaS82dHgB23+nlXLdzYmwP/5iI0jRjGfKXxQ==',key_name='tempest-keypair-65630828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-xc2jvcst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:06:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=2c215d73-ebab-4b74-b2a5-a4b5a0264e89,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG os_vif [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap896acc02-dd, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap896acc02-dd, col_values=(('external_ids', {'iface-id': '896acc02-dd7e-4464-be83-5a9774c03d22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:cc:77', 'vm-uuid': '2c215d73-ebab-4b74-b2a5-a4b5a0264e89'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:08:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:10 user nova-compute[73121]: INFO os_vif [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd')
Aug 15 02:08:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "689cd18c-6031-4971-9505-166b8f7e4217" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "689cd18c-6031-4971-9505-166b8f7e4217" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:08:11 user nova-compute[73121]: INFO nova.compute.claims [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Claim successful on node user
Aug 15 02:08:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:08:11 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:08:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:08:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:08:12 user nova-compute[73121]: INFO nova.virt.block_device [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Booting with volume snapshot 95f7e23a-ad90-4598-970f-235d2ad2b139 at /dev/vda
Aug 15 02:08:12 user nova-compute[73121]: DEBUG nova.policy [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f9c4f2ffebb440cb88132a502d51811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3397dd14ca44c19dc4386aec30a9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:08:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-88b3d82c-b6e7-40bf-a8f0-4a0356f0e785 req-a57fc537-cf90-4ec6-9115-4e9a11e9aedd service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-88b3d82c-b6e7-40bf-a8f0-4a0356f0e785 req-a57fc537-cf90-4ec6-9115-4e9a11e9aedd service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-88b3d82c-b6e7-40bf-a8f0-4a0356f0e785 req-a57fc537-cf90-4ec6-9115-4e9a11e9aedd service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-88b3d82c-b6e7-40bf-a8f0-4a0356f0e785 req-a57fc537-cf90-4ec6-9115-4e9a11e9aedd service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-88b3d82c-b6e7-40bf-a8f0-4a0356f0e785 req-a57fc537-cf90-4ec6-9115-4e9a11e9aedd service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:08:12 user nova-compute[73121]: WARNING nova.compute.manager [req-88b3d82c-b6e7-40bf-a8f0-4a0356f0e785 req-a57fc537-cf90-4ec6-9115-4e9a11e9aedd service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state powering-on.
Aug 15 02:08:13 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Successfully created port: 6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:08:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Successfully updated port: 6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "refresh_cache-689cd18c-6031-4971-9505-166b8f7e4217" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquired lock "refresh_cache-689cd18c-6031-4971-9505-166b8f7e4217" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.compute.manager [req-d0bfebda-e54c-4990-8050-72703afb767f req-57864522-b489-4607-8ed8-899d4f244fb5 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received event network-changed-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.compute.manager [req-d0bfebda-e54c-4990-8050-72703afb767f req-57864522-b489-4607-8ed8-899d4f244fb5 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Refreshing instance network info cache due to event network-changed-6b3dfe3a-6de7-42a8-bb45-260efb277b52. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d0bfebda-e54c-4990-8050-72703afb767f req-57864522-b489-4607-8ed8-899d4f244fb5 service nova] Acquiring lock "refresh_cache-689cd18c-6031-4971-9505-166b8f7e4217" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Updating instance_info_cache with network_info: [{"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Releasing lock "refresh_cache-689cd18c-6031-4971-9505-166b8f7e4217" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Instance network_info: |[{"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d0bfebda-e54c-4990-8050-72703afb767f req-57864522-b489-4607-8ed8-899d4f244fb5 service nova] Acquired lock "refresh_cache-689cd18c-6031-4971-9505-166b8f7e4217" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.network.neutron [req-d0bfebda-e54c-4990-8050-72703afb767f req-57864522-b489-4607-8ed8-899d4f244fb5 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Refreshing network info cache for port 6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065294.9844532, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:08:14 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] VM Resumed (Lifecycle Event)
Aug 15 02:08:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:08:15 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance rebooted successfully.
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-7ef1a6ad-7370-49b8-b509-15ba2de90f5d tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-e0a1d8d2-8a61-45e3-9feb-92849bf8e306 req-39713dc8-bec2-44f2-b17f-cee0e8c71019 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e0a1d8d2-8a61-45e3-9feb-92849bf8e306 req-39713dc8-bec2-44f2-b17f-cee0e8c71019 service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e0a1d8d2-8a61-45e3-9feb-92849bf8e306 req-39713dc8-bec2-44f2-b17f-cee0e8c71019 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e0a1d8d2-8a61-45e3-9feb-92849bf8e306 req-39713dc8-bec2-44f2-b17f-cee0e8c71019 service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-e0a1d8d2-8a61-45e3-9feb-92849bf8e306 req-39713dc8-bec2-44f2-b17f-cee0e8c71019 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:08:15 user nova-compute[73121]: WARNING nova.compute.manager [req-e0a1d8d2-8a61-45e3-9feb-92849bf8e306 req-39713dc8-bec2-44f2-b17f-cee0e8c71019 service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state stopped and task_state powering-on.
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:08:15 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065294.988078, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:08:15 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] VM Started (Lifecycle Event)
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.network.neutron [req-d0bfebda-e54c-4990-8050-72703afb767f req-57864522-b489-4607-8ed8-899d4f244fb5 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Updated VIF entry in instance network info cache for port 6b3dfe3a-6de7-42a8-bb45-260efb277b52. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.network.neutron [req-d0bfebda-e54c-4990-8050-72703afb767f req-57864522-b489-4607-8ed8-899d4f244fb5 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Updating instance_info_cache with network_info: [{"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d0bfebda-e54c-4990-8050-72703afb767f req-57864522-b489-4607-8ed8-899d4f244fb5 service nova] Releasing lock "refresh_cache-689cd18c-6031-4971-9505-166b8f7e4217" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:15 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:08:15 user nova-compute[73121]: INFO nova.compute.claims [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Claim successful on node user
Aug 15 02:08:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.533s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:08:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.policy [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcd426e7c0ae4b179e08d2c6cbeb055d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d90d41f123f4ef9bbaea3ca67b76e36', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:08:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Creating image(s)
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Updating instance_info_cache with network_info: [{"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-4e04a498-4518-46c9-bc49-4d0d5d6aa054" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk 1073741824" returned: 0 in 0.057s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.217s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Successfully created port: eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Cannot resize image /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'migration_context' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Ensure instance console log exists: /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG os_brick.utils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[996b64a4-2a90-45eb-91c2-9303e6ae9832]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d01bdc-db0a-4984-ba38-0ea972c9d2bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c6e45-e49e-485a-8868-0c2976e2bf09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e9b49c-2de5-47df-9893-682a41792eb4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Successfully updated port: eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquired lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-79510722-b38b-4f61-9588-17e1d311763c req-41edaaa0-ef9d-42e3-be35-1ceca61afac4 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-changed-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-79510722-b38b-4f61-9588-17e1d311763c req-41edaaa0-ef9d-42e3-be35-1ceca61afac4 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Refreshing instance network info cache due to event network-changed-eeb90096-6720-4d4b-954c-f03f3eeba489. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-79510722-b38b-4f61-9588-17e1d311763c req-41edaaa0-ef9d-42e3-be35-1ceca61afac4 service nova] Acquiring lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:08:18 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:08:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceea219d-3028-41a6-aae1-087baf2e1284]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG os_brick.utils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== get_connector_properties: return (195ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Updating existing volume attachment record: 8fbb1b18-2d5b-4eff-9794-e6e4b289beae {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:08:18 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating instance_info_cache with network_info: [{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Releasing lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Instance network_info: |[{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-79510722-b38b-4f61-9588-17e1d311763c req-41edaaa0-ef9d-42e3-be35-1ceca61afac4 service nova] Acquired lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.network.neutron [req-79510722-b38b-4f61-9588-17e1d311763c req-41edaaa0-ef9d-42e3-be35-1ceca61afac4 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Refreshing network info cache for port eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Start _get_guest_xml network_info=[{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:08:19 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:19 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-746478903',display_name='tempest-ServerStableDeviceRescueTest-server-746478903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-746478903',id=23,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRwC8YL0jzZcbZMy9BtwKYjRwTz5ZrvOud6U5kgAzyZd8PjwLBMW46Zur0A8UvbTHnO18lr6q0qGSDAbNtQaNyNLrJ+lB9yNbU79Mn6ZlJzF6PuSExtaX1uEuGdot54jQ==',key_name='tempest-keypair-1186469442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d90d41f123f4ef9bbaea3ca67b76e36',ramdisk_id='',reservation_id='r-zzr9ciut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-232377404',owner_user_name='tempest-ServerStableDeviceRescueTest-232377404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd426e7c0ae4b179e08d2c6cbeb055d',uuid=012c74eb-e477-42dc-a04e-908b51e82de1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Converting VIF {"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:c7:ac,bridge_name='br-int',has_traffic_filtering=True,id=eeb90096-6720-4d4b-954c-f03f3eeba489,network=Network(80d553b0-a83b-4da0-b037-c5c21ca2872f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb90096-67') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'pci_devices' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:08:19 user nova-compute[73121]:   <uuid>012c74eb-e477-42dc-a04e-908b51e82de1</uuid>
Aug 15 02:08:19 user nova-compute[73121]:   <name>instance-00000017</name>
Aug 15 02:08:19 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:08:19 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:08:19 user nova-compute[73121]:   <metadata>
Aug 15 02:08:19 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:08:19 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:08:19 user nova-compute[73121]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-746478903</nova:name>
Aug 15 02:08:19 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:08:19</nova:creationTime>
Aug 15 02:08:19 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:08:19 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:08:19 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:08:19 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:08:19 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:08:19 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:08:19 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:08:19 user nova-compute[73121]:       <nova:owner>
Aug 15 02:08:19 user nova-compute[73121]:         <nova:user uuid="dcd426e7c0ae4b179e08d2c6cbeb055d">tempest-ServerStableDeviceRescueTest-232377404-project-member</nova:user>
Aug 15 02:08:19 user nova-compute[73121]:         <nova:project uuid="4d90d41f123f4ef9bbaea3ca67b76e36">tempest-ServerStableDeviceRescueTest-232377404</nova:project>
Aug 15 02:08:19 user nova-compute[73121]:       </nova:owner>
Aug 15 02:08:19 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:08:19 user nova-compute[73121]:       <nova:ports>
Aug 15 02:08:19 user nova-compute[73121]:         <nova:port uuid="eeb90096-6720-4d4b-954c-f03f3eeba489">
Aug 15 02:08:19 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:08:19 user nova-compute[73121]:         </nova:port>
Aug 15 02:08:19 user nova-compute[73121]:       </nova:ports>
Aug 15 02:08:19 user nova-compute[73121]:     </nova:instance>
Aug 15 02:08:19 user nova-compute[73121]:   </metadata>
Aug 15 02:08:19 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:08:19 user nova-compute[73121]:     <system>
Aug 15 02:08:19 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:08:19 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:08:19 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:08:19 user nova-compute[73121]:       <entry name="serial">012c74eb-e477-42dc-a04e-908b51e82de1</entry>
Aug 15 02:08:19 user nova-compute[73121]:       <entry name="uuid">012c74eb-e477-42dc-a04e-908b51e82de1</entry>
Aug 15 02:08:19 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:08:19 user nova-compute[73121]:     </system>
Aug 15 02:08:19 user nova-compute[73121]:   </sysinfo>
Aug 15 02:08:19 user nova-compute[73121]:   <os>
Aug 15 02:08:19 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:08:19 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:08:19 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:08:19 user nova-compute[73121]:   </os>
Aug 15 02:08:19 user nova-compute[73121]:   <features>
Aug 15 02:08:19 user nova-compute[73121]:     <acpi/>
Aug 15 02:08:19 user nova-compute[73121]:     <apic/>
Aug 15 02:08:19 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:08:19 user nova-compute[73121]:   </features>
Aug 15 02:08:19 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:08:19 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:08:19 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:08:19 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:08:19 user nova-compute[73121]:   </clock>
Aug 15 02:08:19 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:08:19 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:08:19 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:08:19 user nova-compute[73121]:   </cpu>
Aug 15 02:08:19 user nova-compute[73121]:   <devices>
Aug 15 02:08:19 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:08:19 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:08:19 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk"/>
Aug 15 02:08:19 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:08:19 user nova-compute[73121]:     </disk>
Aug 15 02:08:19 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:08:19 user nova-compute[73121]:       <mac address="fa:16:3e:6b:c7:ac"/>
Aug 15 02:08:19 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:08:19 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:08:19 user nova-compute[73121]:       <target dev="tapeeb90096-67"/>
Aug 15 02:08:19 user nova-compute[73121]:     </interface>
Aug 15 02:08:19 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:08:19 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/console.log" append="off"/>
Aug 15 02:08:19 user nova-compute[73121]:     </serial>
Aug 15 02:08:19 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:08:19 user nova-compute[73121]:     <video>
Aug 15 02:08:19 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:08:19 user nova-compute[73121]:     </video>
Aug 15 02:08:19 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:08:19 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:08:19 user nova-compute[73121]:     </rng>
Aug 15 02:08:19 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:08:19 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:08:19 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:08:19 user nova-compute[73121]:     </memballoon>
Aug 15 02:08:19 user nova-compute[73121]:   </devices>
Aug 15 02:08:19 user nova-compute[73121]: </domain>
Aug 15 02:08:19 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-746478903',display_name='tempest-ServerStableDeviceRescueTest-server-746478903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-746478903',id=23,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRwC8YL0jzZcbZMy9BtwKYjRwTz5ZrvOud6U5kgAzyZd8PjwLBMW46Zur0A8UvbTHnO18lr6q0qGSDAbNtQaNyNLrJ+lB9yNbU79Mn6ZlJzF6PuSExtaX1uEuGdot54jQ==',key_name='tempest-keypair-1186469442',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d90d41f123f4ef9bbaea3ca67b76e36',ramdisk_id='',reservation_id='r-zzr9ciut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-232377404',owner_user_name='tempest-ServerStableDeviceRescueTest-232377404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:08:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd426e7c0ae4b179e08d2c6cbeb055d',uuid=012c74eb-e477-42dc-a04e-908b51e82de1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Converting VIF {"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:c7:ac,bridge_name='br-int',has_traffic_filtering=True,id=eeb90096-6720-4d4b-954c-f03f3eeba489,network=Network(80d553b0-a83b-4da0-b037-c5c21ca2872f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb90096-67') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG os_vif [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:c7:ac,bridge_name='br-int',has_traffic_filtering=True,id=eeb90096-6720-4d4b-954c-f03f3eeba489,network=Network(80d553b0-a83b-4da0-b037-c5c21ca2872f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb90096-67') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeeb90096-67, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeeb90096-67, col_values=(('external_ids', {'iface-id': 'eeb90096-6720-4d4b-954c-f03f3eeba489', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:c7:ac', 'vm-uuid': '012c74eb-e477-42dc-a04e-908b51e82de1'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:19 user nova-compute[73121]: INFO os_vif [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:c7:ac,bridge_name='br-int',has_traffic_filtering=True,id=eeb90096-6720-4d4b-954c-f03f3eeba489,network=Network(80d553b0-a83b-4da0-b037-c5c21ca2872f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb90096-67')
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] No VIF found with MAC fa:16:3e:6b:c7:ac, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.network.neutron [req-79510722-b38b-4f61-9588-17e1d311763c req-41edaaa0-ef9d-42e3-be35-1ceca61afac4 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updated VIF entry in instance network info cache for port eeb90096-6720-4d4b-954c-f03f3eeba489. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG nova.network.neutron [req-79510722-b38b-4f61-9588-17e1d311763c req-41edaaa0-ef9d-42e3-be35-1ceca61afac4 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating instance_info_cache with network_info: [{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:08:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-79510722-b38b-4f61-9588-17e1d311763c req-41edaaa0-ef9d-42e3-be35-1ceca61afac4 service nova] Releasing lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:08:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:20 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:08:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG nova.compute.manager [req-38122cf8-c587-4371-8a13-5883b13a318a req-06b26900-0ed2-4a52-8905-544620f00f35 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-38122cf8-c587-4371-8a13-5883b13a318a req-06b26900-0ed2-4a52-8905-544620f00f35 service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-38122cf8-c587-4371-8a13-5883b13a318a req-06b26900-0ed2-4a52-8905-544620f00f35 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-38122cf8-c587-4371-8a13-5883b13a318a req-06b26900-0ed2-4a52-8905-544620f00f35 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG nova.compute.manager [req-38122cf8-c587-4371-8a13-5883b13a318a req-06b26900-0ed2-4a52-8905-544620f00f35 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:08:21 user nova-compute[73121]: WARNING nova.compute.manager [req-38122cf8-c587-4371-8a13-5883b13a318a req-06b26900-0ed2-4a52-8905-544620f00f35 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state building and task_state spawning.
Aug 15 02:08:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:08:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-0837a035-8180-41ea-88a0-d9daa5653a7c req-f1c3d70b-d6a7-4283-aeef-50766e48cfe9 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0837a035-8180-41ea-88a0-d9daa5653a7c req-f1c3d70b-d6a7-4283-aeef-50766e48cfe9 service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0837a035-8180-41ea-88a0-d9daa5653a7c req-f1c3d70b-d6a7-4283-aeef-50766e48cfe9 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0837a035-8180-41ea-88a0-d9daa5653a7c req-f1c3d70b-d6a7-4283-aeef-50766e48cfe9 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-0837a035-8180-41ea-88a0-d9daa5653a7c req-f1c3d70b-d6a7-4283-aeef-50766e48cfe9 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:08:23 user nova-compute[73121]: WARNING nova.compute.manager [req-0837a035-8180-41ea-88a0-d9daa5653a7c req-f1c3d70b-d6a7-4283-aeef-50766e48cfe9 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state building and task_state spawning.
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065303.3107688, 012c74eb-e477-42dc-a04e-908b51e82de1 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:08:23 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] VM Resumed (Lifecycle Event)
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:08:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Instance spawned successfully.
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:23 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065303.3112507, 012c74eb-e477-42dc-a04e-908b51e82de1 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:08:23 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] VM Started (Lifecycle Event)
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:08:23 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:08:23 user nova-compute[73121]: INFO nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Took 6.85 seconds to spawn the instance on the hypervisor.
Aug 15 02:08:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:23 user nova-compute[73121]: INFO nova.compute.manager [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Took 7.81 seconds to build instance.
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2f33e23e-5820-4683-9352-df2ae3e2c141 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.925s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:25 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:25 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:25 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7551MB free_disk=25.50564956665039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:08:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 4e04a498-4518-46c9-bc49-4d0d5d6aa054 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 74145868-6dc5-4e1a-be20-80c6cfe659db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance b33dfac8-fd6d-4954-a7a8-632dbbca1304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 689cd18c-6031-4971-9505-166b8f7e4217 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 012c74eb-e477-42dc-a04e-908b51e82de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:08:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:08:29 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Creating image(s)
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Ensure instance console log exists: /opt/stack/data/nova/instances/689cd18c-6031-4971-9505-166b8f7e4217/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Start _get_guest_xml network_info=[{"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '8fbb1b18-2d5b-4eff-9794-e6e4b289beae', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbeNIHcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '689cd18c-6031-4971-9505-166b8f7e4217', 'attached_at': '', 'detached_at': '', 'volume_id': '33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1', 'serial': '33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:08:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbeNIHcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:08:29 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:08:29 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:08:29 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9539a3c-47e1-47d4-944a-1095c00f78e3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:08:29 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f17cb3-70b3-4b6f-8b15-5e8bc9ab77b7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1] added
Aug 15 02:08:29 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4cfdf5-be28-4c4c-86a7-c1de0c491979]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ada4143-c129-4234-8d4e-84b1c1f8ba0d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbeNIHcE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nbeNIHcE" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8271f3-1c35-47c8-87eb-e6253b466665]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nbeNIHcE'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb145f1-0691-44b4-bf2a-10c560b2fedc]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:08:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf801aa-6061-4021-a9ae-ff7116bca5d9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f791eede-4a89-471b-bc90-8df9bb65f1a8 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f791eede-4a89-471b-bc90-8df9bb65f1a8 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f791eede-4a89-471b-bc90-8df9bb65f1a8 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f240f50-d7dc-4cca-85a4-c86b68d64ded]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1, portal: 172.16.0.220,3260]
Aug 15 02:08:30 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1, portal: 172.16.0.220,3260] successful.
Aug 15 02:08:30 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6712b6e0-8fbb-4e49-ad15-45fd715e7a42]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de5af2a-18da-495b-8695-cd49d7ee2cc2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f791eede-4a89-471b-bc90-8df9bb65f1a8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f791eede-4a89-471b-bc90-8df9bb65f1a8 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f791eede-4a89-471b-bc90-8df9bb65f1a8 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 (non-flash)
Aug 15 02:08:30 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79e7ee-6490-4efe-a478-7ce4eb200e0e]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:08:30 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbeNIHcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23032323737666263', 'path': '/dev/sde'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032323737666263', 'path': '/dev/sde'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1789092742',display_name='tempest-TestVolumeBootPattern-server-1789092742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1789092742',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-uqeslzvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:08:12Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=689cd18c-6031-4971-9505-166b8f7e4217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:69,bridge_name='br-int',has_traffic_filtering=True,id=6b3dfe3a-6de7-42a8-bb45-260efb277b52,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b3dfe3a-6d') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'pci_devices' on Instance uuid 689cd18c-6031-4971-9505-166b8f7e4217 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:08:31 user nova-compute[73121]:   <uuid>689cd18c-6031-4971-9505-166b8f7e4217</uuid>
Aug 15 02:08:31 user nova-compute[73121]:   <name>instance-00000016</name>
Aug 15 02:08:31 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:08:31 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:08:31 user nova-compute[73121]:   <metadata>
Aug 15 02:08:31 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:08:31 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:08:31 user nova-compute[73121]:       <nova:name>tempest-TestVolumeBootPattern-server-1789092742</nova:name>
Aug 15 02:08:31 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:08:29</nova:creationTime>
Aug 15 02:08:31 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:08:31 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:08:31 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:08:31 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:08:31 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:08:31 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:08:31 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:08:31 user nova-compute[73121]:       <nova:owner>
Aug 15 02:08:31 user nova-compute[73121]:         <nova:user uuid="9f9c4f2ffebb440cb88132a502d51811">tempest-TestVolumeBootPattern-151395753-project-member</nova:user>
Aug 15 02:08:31 user nova-compute[73121]:         <nova:project uuid="2e3397dd14ca44c19dc4386aec30a9a4">tempest-TestVolumeBootPattern-151395753</nova:project>
Aug 15 02:08:31 user nova-compute[73121]:       </nova:owner>
Aug 15 02:08:31 user nova-compute[73121]:       <nova:ports>
Aug 15 02:08:31 user nova-compute[73121]:         <nova:port uuid="6b3dfe3a-6de7-42a8-bb45-260efb277b52">
Aug 15 02:08:31 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:08:31 user nova-compute[73121]:         </nova:port>
Aug 15 02:08:31 user nova-compute[73121]:       </nova:ports>
Aug 15 02:08:31 user nova-compute[73121]:     </nova:instance>
Aug 15 02:08:31 user nova-compute[73121]:   </metadata>
Aug 15 02:08:31 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:08:31 user nova-compute[73121]:     <system>
Aug 15 02:08:31 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:08:31 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:08:31 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:08:31 user nova-compute[73121]:       <entry name="serial">689cd18c-6031-4971-9505-166b8f7e4217</entry>
Aug 15 02:08:31 user nova-compute[73121]:       <entry name="uuid">689cd18c-6031-4971-9505-166b8f7e4217</entry>
Aug 15 02:08:31 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:08:31 user nova-compute[73121]:     </system>
Aug 15 02:08:31 user nova-compute[73121]:   </sysinfo>
Aug 15 02:08:31 user nova-compute[73121]:   <os>
Aug 15 02:08:31 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:08:31 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:08:31 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:08:31 user nova-compute[73121]:   </os>
Aug 15 02:08:31 user nova-compute[73121]:   <features>
Aug 15 02:08:31 user nova-compute[73121]:     <acpi/>
Aug 15 02:08:31 user nova-compute[73121]:     <apic/>
Aug 15 02:08:31 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:08:31 user nova-compute[73121]:   </features>
Aug 15 02:08:31 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:08:31 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:08:31 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:08:31 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:08:31 user nova-compute[73121]:   </clock>
Aug 15 02:08:31 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:08:31 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:08:31 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:08:31 user nova-compute[73121]:   </cpu>
Aug 15 02:08:31 user nova-compute[73121]:   <devices>
Aug 15 02:08:31 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:08:31 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:08:31 user nova-compute[73121]:       <source dev="/dev/sde"/>
Aug 15 02:08:31 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:08:31 user nova-compute[73121]:       <serial>33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1</serial>
Aug 15 02:08:31 user nova-compute[73121]:     </disk>
Aug 15 02:08:31 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:08:31 user nova-compute[73121]:       <mac address="fa:16:3e:91:29:69"/>
Aug 15 02:08:31 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:08:31 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:08:31 user nova-compute[73121]:       <target dev="tap6b3dfe3a-6d"/>
Aug 15 02:08:31 user nova-compute[73121]:     </interface>
Aug 15 02:08:31 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:08:31 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/689cd18c-6031-4971-9505-166b8f7e4217/console.log" append="off"/>
Aug 15 02:08:31 user nova-compute[73121]:     </serial>
Aug 15 02:08:31 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:08:31 user nova-compute[73121]:     <video>
Aug 15 02:08:31 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:08:31 user nova-compute[73121]:     </video>
Aug 15 02:08:31 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:08:31 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:08:31 user nova-compute[73121]:     </rng>
Aug 15 02:08:31 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:08:31 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:08:31 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:08:31 user nova-compute[73121]:     </memballoon>
Aug 15 02:08:31 user nova-compute[73121]:   </devices>
Aug 15 02:08:31 user nova-compute[73121]: </domain>
Aug 15 02:08:31 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1789092742',display_name='tempest-TestVolumeBootPattern-server-1789092742',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1789092742',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-uqeslzvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:08:12Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=689cd18c-6031-4971-9505-166b8f7e4217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:69,bridge_name='br-int',has_traffic_filtering=True,id=6b3dfe3a-6de7-42a8-bb45-260efb277b52,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b3dfe3a-6d') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG os_vif [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:69,bridge_name='br-int',has_traffic_filtering=True,id=6b3dfe3a-6de7-42a8-bb45-260efb277b52,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b3dfe3a-6d') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6b3dfe3a-6d, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6b3dfe3a-6d, col_values=(('external_ids', {'iface-id': '6b3dfe3a-6de7-42a8-bb45-260efb277b52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:29:69', 'vm-uuid': '689cd18c-6031-4971-9505-166b8f7e4217'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:31 user nova-compute[73121]: INFO os_vif [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:69,bridge_name='br-int',has_traffic_filtering=True,id=6b3dfe3a-6de7-42a8-bb45-260efb277b52,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b3dfe3a-6d')
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:08:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No VIF found with MAC fa:16:3e:91:29:69, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:08:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-edbcfd44-4a51-4c97-89ad-1f7473264a32 req-4f61141a-c3cc-48a4-a033-e83b8467f0ad service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received event network-vif-plugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-edbcfd44-4a51-4c97-89ad-1f7473264a32 req-4f61141a-c3cc-48a4-a033-e83b8467f0ad service nova] Acquiring lock "689cd18c-6031-4971-9505-166b8f7e4217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-edbcfd44-4a51-4c97-89ad-1f7473264a32 req-4f61141a-c3cc-48a4-a033-e83b8467f0ad service nova] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-edbcfd44-4a51-4c97-89ad-1f7473264a32 req-4f61141a-c3cc-48a4-a033-e83b8467f0ad service nova] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-edbcfd44-4a51-4c97-89ad-1f7473264a32 req-4f61141a-c3cc-48a4-a033-e83b8467f0ad service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] No waiting events found dispatching network-vif-plugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:08:33 user nova-compute[73121]: WARNING nova.compute.manager [req-edbcfd44-4a51-4c97-89ad-1f7473264a32 req-4f61141a-c3cc-48a4-a033-e83b8467f0ad service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received unexpected event network-vif-plugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 for instance with vm_state building and task_state spawning.
Aug 15 02:08:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.compute.manager [req-f9762541-1393-4e11-b103-c18b3dbc92d0 req-eb18c07e-a9e0-4b35-b9c1-18bca6957f98 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received event network-vif-plugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f9762541-1393-4e11-b103-c18b3dbc92d0 req-eb18c07e-a9e0-4b35-b9c1-18bca6957f98 service nova] Acquiring lock "689cd18c-6031-4971-9505-166b8f7e4217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f9762541-1393-4e11-b103-c18b3dbc92d0 req-eb18c07e-a9e0-4b35-b9c1-18bca6957f98 service nova] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f9762541-1393-4e11-b103-c18b3dbc92d0 req-eb18c07e-a9e0-4b35-b9c1-18bca6957f98 service nova] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.compute.manager [req-f9762541-1393-4e11-b103-c18b3dbc92d0 req-eb18c07e-a9e0-4b35-b9c1-18bca6957f98 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] No waiting events found dispatching network-vif-plugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:08:35 user nova-compute[73121]: WARNING nova.compute.manager [req-f9762541-1393-4e11-b103-c18b3dbc92d0 req-eb18c07e-a9e0-4b35-b9c1-18bca6957f98 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received unexpected event network-vif-plugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 for instance with vm_state building and task_state spawning.
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065315.6823423, 689cd18c-6031-4971-9505-166b8f7e4217 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:08:35 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] VM Resumed (Lifecycle Event)
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:35 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Instance spawned successfully.
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:35 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065315.685913, 689cd18c-6031-4971-9505-166b8f7e4217 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:08:35 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] VM Started (Lifecycle Event)
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:08:35 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:08:35 user nova-compute[73121]: INFO nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 15 02:08:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:36 user nova-compute[73121]: INFO nova.compute.manager [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Took 24.74 seconds to build instance.
Aug 15 02:08:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7bc0583-f5e0-46cd-a239-741690a088c8 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "689cd18c-6031-4971-9505-166b8f7e4217" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.870s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "d7950f28-0893-49de-a560-bbc0791492b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d7950f28-0893-49de-a560-bbc0791492b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:08:52 user nova-compute[73121]: INFO nova.compute.claims [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Claim successful on node user
Aug 15 02:08:52 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:08:53 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.policy [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d8ef0b0581e4a10b066c15119bafde1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea879c6a9d1f4d58998e077524a07225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:08:53 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Creating image(s)
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "/opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "/opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.201s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk 1073741824" returned: 0 in 0.057s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Successfully created port: 79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Cannot resize image /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:08:53 user nova-compute[73121]: DEBUG nova.objects.instance [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'migration_context' on Instance uuid d7950f28-0893-49de-a560-bbc0791492b5 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Ensure instance console log exists: /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Successfully updated port: 79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "refresh_cache-d7950f28-0893-49de-a560-bbc0791492b5" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquired lock "refresh_cache-d7950f28-0893-49de-a560-bbc0791492b5" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-df92b83e-21f4-475d-818d-0736d9d8c911 req-c6d88bbf-63df-4988-adce-d2847177c592 service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received event network-changed-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-df92b83e-21f4-475d-818d-0736d9d8c911 req-c6d88bbf-63df-4988-adce-d2847177c592 service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Refreshing instance network info cache due to event network-changed-79ad6fe2-2174-4a53-a32d-2c4d306b9e24. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-df92b83e-21f4-475d-818d-0736d9d8c911 req-c6d88bbf-63df-4988-adce-d2847177c592 service nova] Acquiring lock "refresh_cache-d7950f28-0893-49de-a560-bbc0791492b5" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Updating instance_info_cache with network_info: [{"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Releasing lock "refresh_cache-d7950f28-0893-49de-a560-bbc0791492b5" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Instance network_info: |[{"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-df92b83e-21f4-475d-818d-0736d9d8c911 req-c6d88bbf-63df-4988-adce-d2847177c592 service nova] Acquired lock "refresh_cache-d7950f28-0893-49de-a560-bbc0791492b5" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.network.neutron [req-df92b83e-21f4-475d-818d-0736d9d8c911 req-c6d88bbf-63df-4988-adce-d2847177c592 service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Refreshing network info cache for port 79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Start _get_guest_xml network_info=[{"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:08:54 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:54 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1502701635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1502701635',id=24,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-p8igmncs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:08:53Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=d7950f28-0893-49de-a560-bbc0791492b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:68:29,bridge_name='br-int',has_traffic_filtering=True,id=79ad6fe2-2174-4a53-a32d-2c4d306b9e24,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ad6fe2-21') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.objects.instance [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'pci_devices' on Instance uuid d7950f28-0893-49de-a560-bbc0791492b5 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:08:54 user nova-compute[73121]:   <uuid>d7950f28-0893-49de-a560-bbc0791492b5</uuid>
Aug 15 02:08:54 user nova-compute[73121]:   <name>instance-00000018</name>
Aug 15 02:08:54 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:08:54 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:08:54 user nova-compute[73121]:   <metadata>
Aug 15 02:08:54 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:08:54 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:08:54 user nova-compute[73121]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1502701635</nova:name>
Aug 15 02:08:54 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:08:54</nova:creationTime>
Aug 15 02:08:54 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:08:54 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:08:54 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:08:54 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:08:54 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:08:54 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:08:54 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:08:54 user nova-compute[73121]:       <nova:owner>
Aug 15 02:08:54 user nova-compute[73121]:         <nova:user uuid="4d8ef0b0581e4a10b066c15119bafde1">tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member</nova:user>
Aug 15 02:08:54 user nova-compute[73121]:         <nova:project uuid="ea879c6a9d1f4d58998e077524a07225">tempest-ServerBootFromVolumeStableRescueTest-893410799</nova:project>
Aug 15 02:08:54 user nova-compute[73121]:       </nova:owner>
Aug 15 02:08:54 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:08:54 user nova-compute[73121]:       <nova:ports>
Aug 15 02:08:54 user nova-compute[73121]:         <nova:port uuid="79ad6fe2-2174-4a53-a32d-2c4d306b9e24">
Aug 15 02:08:54 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 02:08:54 user nova-compute[73121]:         </nova:port>
Aug 15 02:08:54 user nova-compute[73121]:       </nova:ports>
Aug 15 02:08:54 user nova-compute[73121]:     </nova:instance>
Aug 15 02:08:54 user nova-compute[73121]:   </metadata>
Aug 15 02:08:54 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:08:54 user nova-compute[73121]:     <system>
Aug 15 02:08:54 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:08:54 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:08:54 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:08:54 user nova-compute[73121]:       <entry name="serial">d7950f28-0893-49de-a560-bbc0791492b5</entry>
Aug 15 02:08:54 user nova-compute[73121]:       <entry name="uuid">d7950f28-0893-49de-a560-bbc0791492b5</entry>
Aug 15 02:08:54 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:08:54 user nova-compute[73121]:     </system>
Aug 15 02:08:54 user nova-compute[73121]:   </sysinfo>
Aug 15 02:08:54 user nova-compute[73121]:   <os>
Aug 15 02:08:54 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:08:54 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:08:54 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:08:54 user nova-compute[73121]:   </os>
Aug 15 02:08:54 user nova-compute[73121]:   <features>
Aug 15 02:08:54 user nova-compute[73121]:     <acpi/>
Aug 15 02:08:54 user nova-compute[73121]:     <apic/>
Aug 15 02:08:54 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:08:54 user nova-compute[73121]:   </features>
Aug 15 02:08:54 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:08:54 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:08:54 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:08:54 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:08:54 user nova-compute[73121]:   </clock>
Aug 15 02:08:54 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:08:54 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:08:54 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:08:54 user nova-compute[73121]:   </cpu>
Aug 15 02:08:54 user nova-compute[73121]:   <devices>
Aug 15 02:08:54 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:08:54 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:08:54 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk"/>
Aug 15 02:08:54 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:08:54 user nova-compute[73121]:     </disk>
Aug 15 02:08:54 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:08:54 user nova-compute[73121]:       <mac address="fa:16:3e:18:68:29"/>
Aug 15 02:08:54 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:08:54 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:08:54 user nova-compute[73121]:       <target dev="tap79ad6fe2-21"/>
Aug 15 02:08:54 user nova-compute[73121]:     </interface>
Aug 15 02:08:54 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:08:54 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/console.log" append="off"/>
Aug 15 02:08:54 user nova-compute[73121]:     </serial>
Aug 15 02:08:54 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:08:54 user nova-compute[73121]:     <video>
Aug 15 02:08:54 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:08:54 user nova-compute[73121]:     </video>
Aug 15 02:08:54 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:08:54 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:08:54 user nova-compute[73121]:     </rng>
Aug 15 02:08:54 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:08:54 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:08:54 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:08:54 user nova-compute[73121]:     </memballoon>
Aug 15 02:08:54 user nova-compute[73121]:   </devices>
Aug 15 02:08:54 user nova-compute[73121]: </domain>
Aug 15 02:08:54 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1502701635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1502701635',id=24,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-p8igmncs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:08:53Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=d7950f28-0893-49de-a560-bbc0791492b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:68:29,bridge_name='br-int',has_traffic_filtering=True,id=79ad6fe2-2174-4a53-a32d-2c4d306b9e24,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ad6fe2-21') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG os_vif [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:68:29,bridge_name='br-int',has_traffic_filtering=True,id=79ad6fe2-2174-4a53-a32d-2c4d306b9e24,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ad6fe2-21') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79ad6fe2-21, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap79ad6fe2-21, col_values=(('external_ids', {'iface-id': '79ad6fe2-2174-4a53-a32d-2c4d306b9e24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:68:29', 'vm-uuid': 'd7950f28-0893-49de-a560-bbc0791492b5'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:54 user nova-compute[73121]: INFO os_vif [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:68:29,bridge_name='br-int',has_traffic_filtering=True,id=79ad6fe2-2174-4a53-a32d-2c4d306b9e24,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ad6fe2-21')
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:08:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No VIF found with MAC fa:16:3e:18:68:29, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:08:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-df92b83e-21f4-475d-818d-0736d9d8c911 req-c6d88bbf-63df-4988-adce-d2847177c592 service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Updated VIF entry in instance network info cache for port 79ad6fe2-2174-4a53-a32d-2c4d306b9e24. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:08:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-df92b83e-21f4-475d-818d-0736d9d8c911 req-c6d88bbf-63df-4988-adce-d2847177c592 service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Updating instance_info_cache with network_info: [{"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:08:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-df92b83e-21f4-475d-818d-0736d9d8c911 req-c6d88bbf-63df-4988-adce-d2847177c592 service nova] Releasing lock "refresh_cache-d7950f28-0893-49de-a560-bbc0791492b5" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:08:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-18301534-689c-4b79-a7cf-caee7ccb38e0 req-67d6bb5d-f73e-4574-89d6-c66acaebbecf service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received event network-vif-plugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-18301534-689c-4b79-a7cf-caee7ccb38e0 req-67d6bb5d-f73e-4574-89d6-c66acaebbecf service nova] Acquiring lock "d7950f28-0893-49de-a560-bbc0791492b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-18301534-689c-4b79-a7cf-caee7ccb38e0 req-67d6bb5d-f73e-4574-89d6-c66acaebbecf service nova] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-18301534-689c-4b79-a7cf-caee7ccb38e0 req-67d6bb5d-f73e-4574-89d6-c66acaebbecf service nova] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-18301534-689c-4b79-a7cf-caee7ccb38e0 req-67d6bb5d-f73e-4574-89d6-c66acaebbecf service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] No waiting events found dispatching network-vif-plugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:08:56 user nova-compute[73121]: WARNING nova.compute.manager [req-18301534-689c-4b79-a7cf-caee7ccb38e0 req-67d6bb5d-f73e-4574-89d6-c66acaebbecf service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received unexpected event network-vif-plugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 for instance with vm_state building and task_state spawning.
Aug 15 02:08:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065338.510283, d7950f28-0893-49de-a560-bbc0791492b5 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:08:58 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] VM Resumed (Lifecycle Event)
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:08:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Instance spawned successfully.
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:08:58 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065338.5140626, d7950f28-0893-49de-a560-bbc0791492b5 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:08:58 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] VM Started (Lifecycle Event)
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-2f8f4663-98ad-46ba-81cc-2092347fcd33 req-cf4f1b21-5c7f-414d-bc99-7b435b6f5e1e service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received event network-vif-plugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2f8f4663-98ad-46ba-81cc-2092347fcd33 req-cf4f1b21-5c7f-414d-bc99-7b435b6f5e1e service nova] Acquiring lock "d7950f28-0893-49de-a560-bbc0791492b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2f8f4663-98ad-46ba-81cc-2092347fcd33 req-cf4f1b21-5c7f-414d-bc99-7b435b6f5e1e service nova] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2f8f4663-98ad-46ba-81cc-2092347fcd33 req-cf4f1b21-5c7f-414d-bc99-7b435b6f5e1e service nova] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-2f8f4663-98ad-46ba-81cc-2092347fcd33 req-cf4f1b21-5c7f-414d-bc99-7b435b6f5e1e service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] No waiting events found dispatching network-vif-plugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:08:58 user nova-compute[73121]: WARNING nova.compute.manager [req-2f8f4663-98ad-46ba-81cc-2092347fcd33 req-cf4f1b21-5c7f-414d-bc99-7b435b6f5e1e service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received unexpected event network-vif-plugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 for instance with vm_state building and task_state spawning.
Aug 15 02:08:58 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:08:58 user nova-compute[73121]: INFO nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 15 02:08:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:08:58 user nova-compute[73121]: INFO nova.compute.manager [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Took 6.24 seconds to build instance.
Aug 15 02:08:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-66d1e1fc-dc9a-4d46-862e-9e7c7fb5b04a tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d7950f28-0893-49de-a560-bbc0791492b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.340s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:08:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:10 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:09:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:10 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:09:10 user nova-compute[73121]: INFO nova.compute.claims [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Claim successful on node user
Aug 15 02:09:11 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:09:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:09:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG nova.policy [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f22753e4f3934dddab87961c43c68fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0739b6fd0a4c3097a1e0d329176a78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:09:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Creating image(s)
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.231s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk 1073741824" returned: 0 in 0.100s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Successfully created port: 5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Cannot resize image /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'migration_context' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Ensure instance console log exists: /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Successfully updated port: 5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "refresh_cache-be6f8247-2be1-4add-92e9-54e4bef5c44c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquired lock "refresh_cache-be6f8247-2be1-4add-92e9-54e4bef5c44c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-d225bd13-42b6-4182-a45c-04c1588275f4 req-ffef348e-3450-4f8b-adf9-c13efe53c34b service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-changed-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-d225bd13-42b6-4182-a45c-04c1588275f4 req-ffef348e-3450-4f8b-adf9-c13efe53c34b service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Refreshing instance network info cache due to event network-changed-5cff72bc-b5f5-4ac2-a334-0672a871e44b. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d225bd13-42b6-4182-a45c-04c1588275f4 req-ffef348e-3450-4f8b-adf9-c13efe53c34b service nova] Acquiring lock "refresh_cache-be6f8247-2be1-4add-92e9-54e4bef5c44c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Updating instance_info_cache with network_info: [{"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Releasing lock "refresh_cache-be6f8247-2be1-4add-92e9-54e4bef5c44c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Instance network_info: |[{"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d225bd13-42b6-4182-a45c-04c1588275f4 req-ffef348e-3450-4f8b-adf9-c13efe53c34b service nova] Acquired lock "refresh_cache-be6f8247-2be1-4add-92e9-54e4bef5c44c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.network.neutron [req-d225bd13-42b6-4182-a45c-04c1588275f4 req-ffef348e-3450-4f8b-adf9-c13efe53c34b service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Refreshing network info cache for port 5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Start _get_guest_xml network_info=[{"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:09:13 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:09:13 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-855829615',display_name='tempest-tempest.common.compute-instance-855829615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-855829615',id=25,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcIcrbhJjrYWhm7yxLzom3j8e7JktsAHxdqN24zjZeszcJu/7p3089G9bv7YEcqWJNb7rGjE2FAn8nBvFRG6CPZwnjnAtpFtfW5CD7QywBzacqZTRd6YdGBKys72Rxgfw==',key_name='tempest-keypair-1324962593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-10b7bgr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:09:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=be6f8247-2be1-4add-92e9-54e4bef5c44c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'pci_devices' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:09:13 user nova-compute[73121]:   <uuid>be6f8247-2be1-4add-92e9-54e4bef5c44c</uuid>
Aug 15 02:09:13 user nova-compute[73121]:   <name>instance-00000019</name>
Aug 15 02:09:13 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:09:13 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:09:13 user nova-compute[73121]:   <metadata>
Aug 15 02:09:13 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:09:13 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:09:13 user nova-compute[73121]:       <nova:name>tempest-tempest.common.compute-instance-855829615</nova:name>
Aug 15 02:09:13 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:09:13</nova:creationTime>
Aug 15 02:09:13 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:09:13 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:09:13 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:09:13 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:09:13 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:09:13 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:09:13 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:09:13 user nova-compute[73121]:       <nova:owner>
Aug 15 02:09:13 user nova-compute[73121]:         <nova:user uuid="f22753e4f3934dddab87961c43c68fb2">tempest-ServerActionsTestOtherA-148244694-project-member</nova:user>
Aug 15 02:09:13 user nova-compute[73121]:         <nova:project uuid="fb0739b6fd0a4c3097a1e0d329176a78">tempest-ServerActionsTestOtherA-148244694</nova:project>
Aug 15 02:09:13 user nova-compute[73121]:       </nova:owner>
Aug 15 02:09:13 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:09:13 user nova-compute[73121]:       <nova:ports>
Aug 15 02:09:13 user nova-compute[73121]:         <nova:port uuid="5cff72bc-b5f5-4ac2-a334-0672a871e44b">
Aug 15 02:09:13 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 02:09:13 user nova-compute[73121]:         </nova:port>
Aug 15 02:09:13 user nova-compute[73121]:       </nova:ports>
Aug 15 02:09:13 user nova-compute[73121]:     </nova:instance>
Aug 15 02:09:13 user nova-compute[73121]:   </metadata>
Aug 15 02:09:13 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:09:13 user nova-compute[73121]:     <system>
Aug 15 02:09:13 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:09:13 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:09:13 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:09:13 user nova-compute[73121]:       <entry name="serial">be6f8247-2be1-4add-92e9-54e4bef5c44c</entry>
Aug 15 02:09:13 user nova-compute[73121]:       <entry name="uuid">be6f8247-2be1-4add-92e9-54e4bef5c44c</entry>
Aug 15 02:09:13 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:09:13 user nova-compute[73121]:     </system>
Aug 15 02:09:13 user nova-compute[73121]:   </sysinfo>
Aug 15 02:09:13 user nova-compute[73121]:   <os>
Aug 15 02:09:13 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:09:13 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:09:13 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:09:13 user nova-compute[73121]:   </os>
Aug 15 02:09:13 user nova-compute[73121]:   <features>
Aug 15 02:09:13 user nova-compute[73121]:     <acpi/>
Aug 15 02:09:13 user nova-compute[73121]:     <apic/>
Aug 15 02:09:13 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:09:13 user nova-compute[73121]:   </features>
Aug 15 02:09:13 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:09:13 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:09:13 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:09:13 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:09:13 user nova-compute[73121]:   </clock>
Aug 15 02:09:13 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:09:13 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:09:13 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:09:13 user nova-compute[73121]:   </cpu>
Aug 15 02:09:13 user nova-compute[73121]:   <devices>
Aug 15 02:09:13 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:09:13 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:09:13 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk"/>
Aug 15 02:09:13 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:09:13 user nova-compute[73121]:     </disk>
Aug 15 02:09:13 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:09:13 user nova-compute[73121]:       <mac address="fa:16:3e:28:50:2c"/>
Aug 15 02:09:13 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:09:13 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:09:13 user nova-compute[73121]:       <target dev="tap5cff72bc-b5"/>
Aug 15 02:09:13 user nova-compute[73121]:     </interface>
Aug 15 02:09:13 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:09:13 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/console.log" append="off"/>
Aug 15 02:09:13 user nova-compute[73121]:     </serial>
Aug 15 02:09:13 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:09:13 user nova-compute[73121]:     <video>
Aug 15 02:09:13 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:09:13 user nova-compute[73121]:     </video>
Aug 15 02:09:13 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:09:13 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:09:13 user nova-compute[73121]:     </rng>
Aug 15 02:09:13 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:09:13 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:09:13 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:09:13 user nova-compute[73121]:     </memballoon>
Aug 15 02:09:13 user nova-compute[73121]:   </devices>
Aug 15 02:09:13 user nova-compute[73121]: </domain>
Aug 15 02:09:13 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-855829615',display_name='tempest-tempest.common.compute-instance-855829615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-855829615',id=25,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcIcrbhJjrYWhm7yxLzom3j8e7JktsAHxdqN24zjZeszcJu/7p3089G9bv7YEcqWJNb7rGjE2FAn8nBvFRG6CPZwnjnAtpFtfW5CD7QywBzacqZTRd6YdGBKys72Rxgfw==',key_name='tempest-keypair-1324962593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-10b7bgr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:09:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=be6f8247-2be1-4add-92e9-54e4bef5c44c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG os_vif [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cff72bc-b5, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cff72bc-b5, col_values=(('external_ids', {'iface-id': '5cff72bc-b5f5-4ac2-a334-0672a871e44b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:50:2c', 'vm-uuid': 'be6f8247-2be1-4add-92e9-54e4bef5c44c'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:09:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:09:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:14 user nova-compute[73121]: INFO os_vif [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5')
Aug 15 02:09:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:09:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No VIF found with MAC fa:16:3e:28:50:2c, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:09:14 user nova-compute[73121]: DEBUG nova.network.neutron [req-d225bd13-42b6-4182-a45c-04c1588275f4 req-ffef348e-3450-4f8b-adf9-c13efe53c34b service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Updated VIF entry in instance network info cache for port 5cff72bc-b5f5-4ac2-a334-0672a871e44b. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:09:14 user nova-compute[73121]: DEBUG nova.network.neutron [req-d225bd13-42b6-4182-a45c-04c1588275f4 req-ffef348e-3450-4f8b-adf9-c13efe53c34b service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Updating instance_info_cache with network_info: [{"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:09:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d225bd13-42b6-4182-a45c-04c1588275f4 req-ffef348e-3450-4f8b-adf9-c13efe53c34b service nova] Releasing lock "refresh_cache-be6f8247-2be1-4add-92e9-54e4bef5c44c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-fdf9dff1-de05-4f42-8b81-bf32032f4886 req-81d0af8b-5ba7-46e8-9dc2-2bb402cbadcf service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fdf9dff1-de05-4f42-8b81-bf32032f4886 req-81d0af8b-5ba7-46e8-9dc2-2bb402cbadcf service nova] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fdf9dff1-de05-4f42-8b81-bf32032f4886 req-81d0af8b-5ba7-46e8-9dc2-2bb402cbadcf service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fdf9dff1-de05-4f42-8b81-bf32032f4886 req-81d0af8b-5ba7-46e8-9dc2-2bb402cbadcf service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-fdf9dff1-de05-4f42-8b81-bf32032f4886 req-81d0af8b-5ba7-46e8-9dc2-2bb402cbadcf service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] No waiting events found dispatching network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:15 user nova-compute[73121]: WARNING nova.compute.manager [req-fdf9dff1-de05-4f42-8b81-bf32032f4886 req-81d0af8b-5ba7-46e8-9dc2-2bb402cbadcf service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received unexpected event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b for instance with vm_state building and task_state spawning.
Aug 15 02:09:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:16 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065357.605248, be6f8247-2be1-4add-92e9-54e4bef5c44c => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:09:17 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] VM Resumed (Lifecycle Event)
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:09:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Instance spawned successfully.
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:17 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065357.6073987, be6f8247-2be1-4add-92e9-54e4bef5c44c => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:09:17 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] VM Started (Lifecycle Event)
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:09:17 user nova-compute[73121]: INFO nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:09:17 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.compute.manager [req-f135661f-d6a2-4685-8d87-32f77af55f94 req-833f1c29-6502-474c-b72a-1662ddeac2de service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f135661f-d6a2-4685-8d87-32f77af55f94 req-833f1c29-6502-474c-b72a-1662ddeac2de service nova] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f135661f-d6a2-4685-8d87-32f77af55f94 req-833f1c29-6502-474c-b72a-1662ddeac2de service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f135661f-d6a2-4685-8d87-32f77af55f94 req-833f1c29-6502-474c-b72a-1662ddeac2de service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:17 user nova-compute[73121]: DEBUG nova.compute.manager [req-f135661f-d6a2-4685-8d87-32f77af55f94 req-833f1c29-6502-474c-b72a-1662ddeac2de service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] No waiting events found dispatching network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:17 user nova-compute[73121]: WARNING nova.compute.manager [req-f135661f-d6a2-4685-8d87-32f77af55f94 req-833f1c29-6502-474c-b72a-1662ddeac2de service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received unexpected event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b for instance with vm_state building and task_state spawning.
Aug 15 02:09:17 user nova-compute[73121]: INFO nova.compute.manager [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Took 7.24 seconds to build instance.
Aug 15 02:09:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6f318080-73e8-4442-801b-bc083b13bff5 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.360s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updating instance_info_cache with network_info: [{"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:09:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:09:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:22 user nova-compute[73121]: INFO nova.compute.manager [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Terminating instance
Aug 15 02:09:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-cb018ec6-8870-455d-b577-d9ad4ac5a07e req-f511830a-b9f5-4125-8f6e-4c31ee8f076f service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received event network-changed-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-cb018ec6-8870-455d-b577-d9ad4ac5a07e req-f511830a-b9f5-4125-8f6e-4c31ee8f076f service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Refreshing instance network info cache due to event network-changed-624d78ac-3c50-4113-9b04-b3c96b50d521. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cb018ec6-8870-455d-b577-d9ad4ac5a07e req-f511830a-b9f5-4125-8f6e-4c31ee8f076f service nova] Acquiring lock "refresh_cache-74145868-6dc5-4e1a-be20-80c6cfe659db" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cb018ec6-8870-455d-b577-d9ad4ac5a07e req-f511830a-b9f5-4125-8f6e-4c31ee8f076f service nova] Acquired lock "refresh_cache-74145868-6dc5-4e1a-be20-80c6cfe659db" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG nova.network.neutron [req-cb018ec6-8870-455d-b577-d9ad4ac5a07e req-f511830a-b9f5-4125-8f6e-4c31ee8f076f service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Refreshing network info cache for port 624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-2eadf6fb-d830-4ea8-8ca4-6a43d0c4e265 req-050cd1c7-97b4-442c-8d1e-be56af41f747 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received event network-vif-unplugged-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2eadf6fb-d830-4ea8-8ca4-6a43d0c4e265 req-050cd1c7-97b4-442c-8d1e-be56af41f747 service nova] Acquiring lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2eadf6fb-d830-4ea8-8ca4-6a43d0c4e265 req-050cd1c7-97b4-442c-8d1e-be56af41f747 service nova] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2eadf6fb-d830-4ea8-8ca4-6a43d0c4e265 req-050cd1c7-97b4-442c-8d1e-be56af41f747 service nova] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-2eadf6fb-d830-4ea8-8ca4-6a43d0c4e265 req-050cd1c7-97b4-442c-8d1e-be56af41f747 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] No waiting events found dispatching network-vif-unplugged-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-2eadf6fb-d830-4ea8-8ca4-6a43d0c4e265 req-050cd1c7-97b4-442c-8d1e-be56af41f747 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received event network-vif-unplugged-963ddb92-0719-440d-b59a-a485de0837f9 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "74145868-6dc5-4e1a-be20-80c6cfe659db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:23 user nova-compute[73121]: INFO nova.compute.manager [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Terminating instance
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:09:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Instance destroyed successfully.
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lazy-loading 'resources' on Instance uuid 4e04a498-4518-46c9-bc49-4d0d5d6aa054 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1403265403',display_name='tempest-ServersNegativeTestJSON-server-1403265403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1403265403',id=3,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='104f505852da4e74b4afddadf5b4a9a5',ramdisk_id='',reservation_id='r-1w8u20as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-68547960',owner_user_name='tempest-ServersNegativeTestJSON-68547960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:00:41Z,user_data=None,user_id='e4105e54b7264bb3aa05ceeccbf32277',uuid=4e04a498-4518-46c9-bc49-4d0d5d6aa054,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converting VIF {"id": "963ddb92-0719-440d-b59a-a485de0837f9", "address": "fa:16:3e:01:3c:bf", "network": {"id": "82edb567-9218-47d6-9f00-fd126d081538", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-637792268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "104f505852da4e74b4afddadf5b4a9a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap963ddb92-07", "ovs_interfaceid": "963ddb92-0719-440d-b59a-a485de0837f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:3c:bf,bridge_name='br-int',has_traffic_filtering=True,id=963ddb92-0719-440d-b59a-a485de0837f9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963ddb92-07') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG os_vif [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:3c:bf,bridge_name='br-int',has_traffic_filtering=True,id=963ddb92-0719-440d-b59a-a485de0837f9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963ddb92-07') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap963ddb92-07, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:23 user nova-compute[73121]: INFO os_vif [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:3c:bf,bridge_name='br-int',has_traffic_filtering=True,id=963ddb92-0719-440d-b59a-a485de0837f9,network=Network(82edb567-9218-47d6-9f00-fd126d081538),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap963ddb92-07')
Aug 15 02:09:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Deleting instance files /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054_del
Aug 15 02:09:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Deletion of /opt/stack/data/nova/instances/4e04a498-4518-46c9-bc49-4d0d5d6aa054_del complete
Aug 15 02:09:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:23 user nova-compute[73121]: INFO nova.compute.manager [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Took 1.36 seconds to destroy the instance on the hypervisor.
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.network.neutron [req-cb018ec6-8870-455d-b577-d9ad4ac5a07e req-f511830a-b9f5-4125-8f6e-4c31ee8f076f service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Updated VIF entry in instance network info cache for port 624d78ac-3c50-4113-9b04-b3c96b50d521. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.network.neutron [req-cb018ec6-8870-455d-b577-d9ad4ac5a07e req-f511830a-b9f5-4125-8f6e-4c31ee8f076f service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Updating instance_info_cache with network_info: [{"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cb018ec6-8870-455d-b577-d9ad4ac5a07e req-f511830a-b9f5-4125-8f6e-4c31ee8f076f service nova] Releasing lock "refresh_cache-74145868-6dc5-4e1a-be20-80c6cfe659db" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddef41b1-d46a-48e8-957c-5dca0640ee50 req-e02ae73a-6036-4002-97a4-a2a9bf74d815 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received event network-vif-unplugged-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddef41b1-d46a-48e8-957c-5dca0640ee50 req-e02ae73a-6036-4002-97a4-a2a9bf74d815 service nova] Acquiring lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddef41b1-d46a-48e8-957c-5dca0640ee50 req-e02ae73a-6036-4002-97a4-a2a9bf74d815 service nova] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ddef41b1-d46a-48e8-957c-5dca0640ee50 req-e02ae73a-6036-4002-97a4-a2a9bf74d815 service nova] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddef41b1-d46a-48e8-957c-5dca0640ee50 req-e02ae73a-6036-4002-97a4-a2a9bf74d815 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] No waiting events found dispatching network-vif-unplugged-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.compute.manager [req-ddef41b1-d46a-48e8-957c-5dca0640ee50 req-e02ae73a-6036-4002-97a4-a2a9bf74d815 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received event network-vif-unplugged-624d78ac-3c50-4113-9b04-b3c96b50d521 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Instance destroyed successfully.
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'resources' on Instance uuid 74145868-6dc5-4e1a-be20-80c6cfe659db {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:07:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-646150611',display_name='tempest-AttachVolumeNegativeTest-server-646150611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-646150611',id=20,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSlhvISeozWVHlWR1ZzRg1V26ieyjbph3s6lgo+sd7tXYT6u1t+txu8qou0DZO6HryztS2G6E9/idYvAZ/UMpPPrVadqbYOxMsuV2V9hSkq3crk5fBNAMXJtkYfTsEXQg==',key_name='tempest-keypair-511685617',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:07:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-eq9kh2hl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=74145868-6dc5-4e1a-be20-80c6cfe659db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "624d78ac-3c50-4113-9b04-b3c96b50d521", "address": "fa:16:3e:41:89:ba", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap624d78ac-3c", "ovs_interfaceid": "624d78ac-3c50-4113-9b04-b3c96b50d521", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:89:ba,bridge_name='br-int',has_traffic_filtering=True,id=624d78ac-3c50-4113-9b04-b3c96b50d521,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624d78ac-3c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG os_vif [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:89:ba,bridge_name='br-int',has_traffic_filtering=True,id=624d78ac-3c50-4113-9b04-b3c96b50d521,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624d78ac-3c') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap624d78ac-3c, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:09:24 user nova-compute[73121]: INFO os_vif [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:89:ba,bridge_name='br-int',has_traffic_filtering=True,id=624d78ac-3c50-4113-9b04-b3c96b50d521,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap624d78ac-3c')
Aug 15 02:09:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Deleting instance files /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db_del
Aug 15 02:09:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Deletion of /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db_del complete
Aug 15 02:09:24 user nova-compute[73121]: INFO nova.compute.manager [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json" returned: 1 in 0.223s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk --force-share --output=json' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:09:24 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000014, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/74145868-6dc5-4e1a-be20-80c6cfe659db/disk
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:09:24 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Took 0.93 seconds to deallocate network for instance.
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-7f4a73a3-8be7-4647-afe4-a686d1889532 req-ab68fe22-1908-4af7-9502-4ade01e508e1 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received event network-vif-plugged-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7f4a73a3-8be7-4647-afe4-a686d1889532 req-ab68fe22-1908-4af7-9502-4ade01e508e1 service nova] Acquiring lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7f4a73a3-8be7-4647-afe4-a686d1889532 req-ab68fe22-1908-4af7-9502-4ade01e508e1 service nova] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7f4a73a3-8be7-4647-afe4-a686d1889532 req-ab68fe22-1908-4af7-9502-4ade01e508e1 service nova] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-7f4a73a3-8be7-4647-afe4-a686d1889532 req-ab68fe22-1908-4af7-9502-4ade01e508e1 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] No waiting events found dispatching network-vif-plugged-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:25 user nova-compute[73121]: WARNING nova.compute.manager [req-7f4a73a3-8be7-4647-afe4-a686d1889532 req-ab68fe22-1908-4af7-9502-4ade01e508e1 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received unexpected event network-vif-plugged-963ddb92-0719-440d-b59a-a485de0837f9 for instance with vm_state deleted and task_state None.
Aug 15 02:09:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:25 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:09:25 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:09:25 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7071MB free_disk=25.436725616455078GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:09:25 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Took 1.47 seconds to deallocate network for instance.
Aug 15 02:09:25 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.070s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.166s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:25 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Deleted allocations for instance 4e04a498-4518-46c9-bc49-4d0d5d6aa054
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: WARNING nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 74145868-6dc5-4e1a-be20-80c6cfe659db is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance b33dfac8-fd6d-4954-a7a8-632dbbca1304 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 689cd18c-6031-4971-9505-166b8f7e4217 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 012c74eb-e477-42dc-a04e-908b51e82de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7950f28-0893-49de-a560-bbc0791492b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance be6f8247-2be1-4add-92e9-54e4bef5c44c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-81c4aecf-2468-43c9-8b9f-d67784481878 req-7c8610d9-6fde-4edd-af34-a10d57582106 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received event network-vif-plugged-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-81c4aecf-2468-43c9-8b9f-d67784481878 req-7c8610d9-6fde-4edd-af34-a10d57582106 service nova] Acquiring lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-81c4aecf-2468-43c9-8b9f-d67784481878 req-7c8610d9-6fde-4edd-af34-a10d57582106 service nova] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-81c4aecf-2468-43c9-8b9f-d67784481878 req-7c8610d9-6fde-4edd-af34-a10d57582106 service nova] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-81c4aecf-2468-43c9-8b9f-d67784481878 req-7c8610d9-6fde-4edd-af34-a10d57582106 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] No waiting events found dispatching network-vif-plugged-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:26 user nova-compute[73121]: WARNING nova.compute.manager [req-81c4aecf-2468-43c9-8b9f-d67784481878 req-7c8610d9-6fde-4edd-af34-a10d57582106 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received unexpected event network-vif-plugged-624d78ac-3c50-4113-9b04-b3c96b50d521 for instance with vm_state deleted and task_state None.
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-81c4aecf-2468-43c9-8b9f-d67784481878 req-7c8610d9-6fde-4edd-af34-a10d57582106 service nova] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Received event network-vif-deleted-963ddb92-0719-440d-b59a-a485de0837f9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8fddc80e-0926-4fb8-b35c-680d22a889b7 tempest-ServersNegativeTestJSON-68547960 tempest-ServersNegativeTestJSON-68547960-project-member] Lock "4e04a498-4518-46c9-bc49-4d0d5d6aa054" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.645s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.661s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.004s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:26 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Deleted allocations for instance 74145868-6dc5-4e1a-be20-80c6cfe659db
Aug 15 02:09:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f684840d-14b1-4859-a95a-cefd69a5b6d0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "74145868-6dc5-4e1a-be20-80c6cfe659db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.259s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-da4f2751-6a9e-4314-83d8-be9c34644922 req-faa7b81e-ff1c-43ae-bed6-32e112c8e236 service nova] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Received event network-vif-deleted-624d78ac-3c50-4113-9b04-b3c96b50d521 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:09:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:09:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:09:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:30 user nova-compute[73121]: INFO nova.compute.manager [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Terminating instance
Aug 15 02:09:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-d5447338-1649-42b6-8d94-16082799c702 req-5ac8d65b-638e-4f69-b051-73c62e3b0edf service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received event network-vif-unplugged-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d5447338-1649-42b6-8d94-16082799c702 req-5ac8d65b-638e-4f69-b051-73c62e3b0edf service nova] Acquiring lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d5447338-1649-42b6-8d94-16082799c702 req-5ac8d65b-638e-4f69-b051-73c62e3b0edf service nova] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d5447338-1649-42b6-8d94-16082799c702 req-5ac8d65b-638e-4f69-b051-73c62e3b0edf service nova] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-d5447338-1649-42b6-8d94-16082799c702 req-5ac8d65b-638e-4f69-b051-73c62e3b0edf service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] No waiting events found dispatching network-vif-unplugged-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-d5447338-1649-42b6-8d94-16082799c702 req-5ac8d65b-638e-4f69-b051-73c62e3b0edf service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received event network-vif-unplugged-22052ee1-246a-432e-aedf-2e44fbef2098 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:09:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Instance destroyed successfully.
Aug 15 02:09:31 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lazy-loading 'resources' on Instance uuid b33dfac8-fd6d-4954-a7a8-632dbbca1304 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1699823232',display_name='tempest-VolumesActionsTest-instance-1699823232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1699823232',id=21,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='65be7e8458ae4063b08bdf6cca18f36e',ramdisk_id='',reservation_id='r-72q0vwra',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-469015841',owner_user_name='tempest-VolumesActionsTest-469015841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:07:47Z,user_data=None,user_id='c4c4cfb8a12443a4925a3f8d0814abd8',uuid=b33dfac8-fd6d-4954-a7a8-632dbbca1304,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converting VIF {"id": "22052ee1-246a-432e-aedf-2e44fbef2098", "address": "fa:16:3e:6a:b6:e5", "network": {"id": "59e62553-c77f-4102-92f5-b99b82888fec", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1432107992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "65be7e8458ae4063b08bdf6cca18f36e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22052ee1-24", "ovs_interfaceid": "22052ee1-246a-432e-aedf-2e44fbef2098", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:b6:e5,bridge_name='br-int',has_traffic_filtering=True,id=22052ee1-246a-432e-aedf-2e44fbef2098,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22052ee1-24') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG os_vif [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:b6:e5,bridge_name='br-int',has_traffic_filtering=True,id=22052ee1-246a-432e-aedf-2e44fbef2098,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22052ee1-24') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22052ee1-24, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:31 user nova-compute[73121]: INFO os_vif [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:b6:e5,bridge_name='br-int',has_traffic_filtering=True,id=22052ee1-246a-432e-aedf-2e44fbef2098,network=Network(59e62553-c77f-4102-92f5-b99b82888fec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22052ee1-24')
Aug 15 02:09:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Deleting instance files /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304_del
Aug 15 02:09:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Deletion of /opt/stack/data/nova/instances/b33dfac8-fd6d-4954-a7a8-632dbbca1304_del complete
Aug 15 02:09:31 user nova-compute[73121]: INFO nova.compute.manager [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 02:09:31 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:09:31 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:09:31 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Took 0.64 seconds to deallocate network for instance.
Aug 15 02:09:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:32 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Deleted allocations for instance b33dfac8-fd6d-4954-a7a8-632dbbca1304
Aug 15 02:09:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5bfdb4d2-3d8f-431e-ae8a-aae3948daf7b tempest-VolumesActionsTest-469015841 tempest-VolumesActionsTest-469015841-project-member] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-a96821c7-4f97-4ba2-b6eb-82b891a77b45 req-97b4e99b-b906-4b3c-95ec-fd16ef7b3e9d service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received event network-vif-plugged-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a96821c7-4f97-4ba2-b6eb-82b891a77b45 req-97b4e99b-b906-4b3c-95ec-fd16ef7b3e9d service nova] Acquiring lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a96821c7-4f97-4ba2-b6eb-82b891a77b45 req-97b4e99b-b906-4b3c-95ec-fd16ef7b3e9d service nova] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a96821c7-4f97-4ba2-b6eb-82b891a77b45 req-97b4e99b-b906-4b3c-95ec-fd16ef7b3e9d service nova] Lock "b33dfac8-fd6d-4954-a7a8-632dbbca1304-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-a96821c7-4f97-4ba2-b6eb-82b891a77b45 req-97b4e99b-b906-4b3c-95ec-fd16ef7b3e9d service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] No waiting events found dispatching network-vif-plugged-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:32 user nova-compute[73121]: WARNING nova.compute.manager [req-a96821c7-4f97-4ba2-b6eb-82b891a77b45 req-97b4e99b-b906-4b3c-95ec-fd16ef7b3e9d service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received unexpected event network-vif-plugged-22052ee1-246a-432e-aedf-2e44fbef2098 for instance with vm_state deleted and task_state None.
Aug 15 02:09:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-a96821c7-4f97-4ba2-b6eb-82b891a77b45 req-97b4e99b-b906-4b3c-95ec-fd16ef7b3e9d service nova] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Received event network-vif-deleted-22052ee1-246a-432e-aedf-2e44fbef2098 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:38 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065363.3053284, 4e04a498-4518-46c9-bc49-4d0d5d6aa054 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:09:38 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] VM Stopped (Lifecycle Event)
Aug 15 02:09:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f8b565b7-9edf-42cd-9d7a-9fe53b91e481 None None] [instance: 4e04a498-4518-46c9-bc49-4d0d5d6aa054] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:09:39 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065364.184799, 74145868-6dc5-4e1a-be20-80c6cfe659db => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:09:39 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] VM Stopped (Lifecycle Event)
Aug 15 02:09:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c6d8d004-eb26-41c1-9e40-d33022aad1a6 None None] [instance: 74145868-6dc5-4e1a-be20-80c6cfe659db] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:09:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:46 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065371.228679, b33dfac8-fd6d-4954-a7a8-632dbbca1304 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:09:46 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] VM Stopped (Lifecycle Event)
Aug 15 02:09:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a0f54ced-0e8e-4cab-a70f-7deece5d0280 None None] [instance: b33dfac8-fd6d-4954-a7a8-632dbbca1304] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:09:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:09:49 user nova-compute[73121]: INFO nova.compute.claims [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Claim successful on node user
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:09:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.policy [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38933c03922f45f394cabbf65159d3fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547392e371404b7ebb8e83f9cbba108a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:09:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Creating image(s)
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "/opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "/opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "/opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk 1073741824" returned: 0 in 0.056s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Successfully created port: abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Cannot resize image /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG nova.objects.instance [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'migration_context' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Ensure instance console log exists: /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Successfully updated port: abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquired lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-54d92855-0794-444f-8214-6e5bb6f01483 req-bdbe5a36-32c1-4ecf-b087-1e9e71d3b202 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received event network-changed-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-54d92855-0794-444f-8214-6e5bb6f01483 req-bdbe5a36-32c1-4ecf-b087-1e9e71d3b202 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Refreshing instance network info cache due to event network-changed-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-54d92855-0794-444f-8214-6e5bb6f01483 req-bdbe5a36-32c1-4ecf-b087-1e9e71d3b202 service nova] Acquiring lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updating instance_info_cache with network_info: [{"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Releasing lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Instance network_info: |[{"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-54d92855-0794-444f-8214-6e5bb6f01483 req-bdbe5a36-32c1-4ecf-b087-1e9e71d3b202 service nova] Acquired lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-54d92855-0794-444f-8214-6e5bb6f01483 req-bdbe5a36-32c1-4ecf-b087-1e9e71d3b202 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Refreshing network info cache for port abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Start _get_guest_xml network_info=[{"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:09:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:09:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-478408445',display_name='tempest-SnapshotDataIntegrityTests-server-478408445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-478408445',id=26,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO7dI2Mqqft7ydkiwRi7SUQU7xhIZF504f/WyU8muWBqKoNXTise1De59N2cBMepA2d80+SiQEyS7JCoNou7LzyX1Ds2aRTq28WXGZE1UvWz4sMzxwhX381VVPxtnEtfg==',key_name='tempest-keypair-485584573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547392e371404b7ebb8e83f9cbba108a',ramdisk_id='',reservation_id='r-lzg6jjo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-293199597',owner_user_name='tempest-SnapshotDataIntegrityTests-293199597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38933c03922f45f394cabbf65159d3fb',uuid=afb831b1-b2b9-4771-a759-47fbaa2a0382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Converting VIF {"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:c1:76,bridge_name='br-int',has_traffic_filtering=True,id=abf3d1bd-5c66-4e3a-8aa3-2323ced964fb,network=Network(e05cd91f-a287-46de-8159-b5dbc49e9896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf3d1bd-5c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'pci_devices' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:09:51 user nova-compute[73121]:   <uuid>afb831b1-b2b9-4771-a759-47fbaa2a0382</uuid>
Aug 15 02:09:51 user nova-compute[73121]:   <name>instance-0000001a</name>
Aug 15 02:09:51 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:09:51 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:09:51 user nova-compute[73121]:   <metadata>
Aug 15 02:09:51 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:09:51 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:09:51 user nova-compute[73121]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-478408445</nova:name>
Aug 15 02:09:51 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:09:51</nova:creationTime>
Aug 15 02:09:51 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:09:51 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:09:51 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:09:51 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:09:51 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:09:51 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:09:51 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:09:51 user nova-compute[73121]:       <nova:owner>
Aug 15 02:09:51 user nova-compute[73121]:         <nova:user uuid="38933c03922f45f394cabbf65159d3fb">tempest-SnapshotDataIntegrityTests-293199597-project-member</nova:user>
Aug 15 02:09:51 user nova-compute[73121]:         <nova:project uuid="547392e371404b7ebb8e83f9cbba108a">tempest-SnapshotDataIntegrityTests-293199597</nova:project>
Aug 15 02:09:51 user nova-compute[73121]:       </nova:owner>
Aug 15 02:09:51 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:09:51 user nova-compute[73121]:       <nova:ports>
Aug 15 02:09:51 user nova-compute[73121]:         <nova:port uuid="abf3d1bd-5c66-4e3a-8aa3-2323ced964fb">
Aug 15 02:09:51 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 02:09:51 user nova-compute[73121]:         </nova:port>
Aug 15 02:09:51 user nova-compute[73121]:       </nova:ports>
Aug 15 02:09:51 user nova-compute[73121]:     </nova:instance>
Aug 15 02:09:51 user nova-compute[73121]:   </metadata>
Aug 15 02:09:51 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:09:51 user nova-compute[73121]:     <system>
Aug 15 02:09:51 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:09:51 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:09:51 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:09:51 user nova-compute[73121]:       <entry name="serial">afb831b1-b2b9-4771-a759-47fbaa2a0382</entry>
Aug 15 02:09:51 user nova-compute[73121]:       <entry name="uuid">afb831b1-b2b9-4771-a759-47fbaa2a0382</entry>
Aug 15 02:09:51 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:09:51 user nova-compute[73121]:     </system>
Aug 15 02:09:51 user nova-compute[73121]:   </sysinfo>
Aug 15 02:09:51 user nova-compute[73121]:   <os>
Aug 15 02:09:51 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:09:51 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:09:51 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:09:51 user nova-compute[73121]:   </os>
Aug 15 02:09:51 user nova-compute[73121]:   <features>
Aug 15 02:09:51 user nova-compute[73121]:     <acpi/>
Aug 15 02:09:51 user nova-compute[73121]:     <apic/>
Aug 15 02:09:51 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:09:51 user nova-compute[73121]:   </features>
Aug 15 02:09:51 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:09:51 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:09:51 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:09:51 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:09:51 user nova-compute[73121]:   </clock>
Aug 15 02:09:51 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:09:51 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:09:51 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:09:51 user nova-compute[73121]:   </cpu>
Aug 15 02:09:51 user nova-compute[73121]:   <devices>
Aug 15 02:09:51 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:09:51 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:09:51 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk"/>
Aug 15 02:09:51 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:09:51 user nova-compute[73121]:     </disk>
Aug 15 02:09:51 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:09:51 user nova-compute[73121]:       <mac address="fa:16:3e:1c:c1:76"/>
Aug 15 02:09:51 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:09:51 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:09:51 user nova-compute[73121]:       <target dev="tapabf3d1bd-5c"/>
Aug 15 02:09:51 user nova-compute[73121]:     </interface>
Aug 15 02:09:51 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:09:51 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/console.log" append="off"/>
Aug 15 02:09:51 user nova-compute[73121]:     </serial>
Aug 15 02:09:51 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:09:51 user nova-compute[73121]:     <video>
Aug 15 02:09:51 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:09:51 user nova-compute[73121]:     </video>
Aug 15 02:09:51 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:09:51 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:09:51 user nova-compute[73121]:     </rng>
Aug 15 02:09:51 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:09:51 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:09:51 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:09:51 user nova-compute[73121]:     </memballoon>
Aug 15 02:09:51 user nova-compute[73121]:   </devices>
Aug 15 02:09:51 user nova-compute[73121]: </domain>
Aug 15 02:09:51 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-478408445',display_name='tempest-SnapshotDataIntegrityTests-server-478408445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-478408445',id=26,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO7dI2Mqqft7ydkiwRi7SUQU7xhIZF504f/WyU8muWBqKoNXTise1De59N2cBMepA2d80+SiQEyS7JCoNou7LzyX1Ds2aRTq28WXGZE1UvWz4sMzxwhX381VVPxtnEtfg==',key_name='tempest-keypair-485584573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='547392e371404b7ebb8e83f9cbba108a',ramdisk_id='',reservation_id='r-lzg6jjo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-293199597',owner_user_name='tempest-SnapshotDataIntegrityTests-293199597-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:09:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38933c03922f45f394cabbf65159d3fb',uuid=afb831b1-b2b9-4771-a759-47fbaa2a0382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Converting VIF {"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:c1:76,bridge_name='br-int',has_traffic_filtering=True,id=abf3d1bd-5c66-4e3a-8aa3-2323ced964fb,network=Network(e05cd91f-a287-46de-8159-b5dbc49e9896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf3d1bd-5c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG os_vif [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:c1:76,bridge_name='br-int',has_traffic_filtering=True,id=abf3d1bd-5c66-4e3a-8aa3-2323ced964fb,network=Network(e05cd91f-a287-46de-8159-b5dbc49e9896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf3d1bd-5c') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabf3d1bd-5c, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapabf3d1bd-5c, col_values=(('external_ids', {'iface-id': 'abf3d1bd-5c66-4e3a-8aa3-2323ced964fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:c1:76', 'vm-uuid': 'afb831b1-b2b9-4771-a759-47fbaa2a0382'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:51 user nova-compute[73121]: INFO os_vif [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:c1:76,bridge_name='br-int',has_traffic_filtering=True,id=abf3d1bd-5c66-4e3a-8aa3-2323ced964fb,network=Network(e05cd91f-a287-46de-8159-b5dbc49e9896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf3d1bd-5c')
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No VIF found with MAC fa:16:3e:1c:c1:76, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-54d92855-0794-444f-8214-6e5bb6f01483 req-bdbe5a36-32c1-4ecf-b087-1e9e71d3b202 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updated VIF entry in instance network info cache for port abf3d1bd-5c66-4e3a-8aa3-2323ced964fb. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-54d92855-0794-444f-8214-6e5bb6f01483 req-bdbe5a36-32c1-4ecf-b087-1e9e71d3b202 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updating instance_info_cache with network_info: [{"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:09:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-54d92855-0794-444f-8214-6e5bb6f01483 req-bdbe5a36-32c1-4ecf-b087-1e9e71d3b202 service nova] Releasing lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:09:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-916438c0-0b27-4c32-9093-3e0e9ca48ef5 req-e0a65675-c24d-4664-a75f-68fd283f1f03 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received event network-vif-plugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-916438c0-0b27-4c32-9093-3e0e9ca48ef5 req-e0a65675-c24d-4664-a75f-68fd283f1f03 service nova] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-916438c0-0b27-4c32-9093-3e0e9ca48ef5 req-e0a65675-c24d-4664-a75f-68fd283f1f03 service nova] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-916438c0-0b27-4c32-9093-3e0e9ca48ef5 req-e0a65675-c24d-4664-a75f-68fd283f1f03 service nova] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-916438c0-0b27-4c32-9093-3e0e9ca48ef5 req-e0a65675-c24d-4664-a75f-68fd283f1f03 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] No waiting events found dispatching network-vif-plugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:53 user nova-compute[73121]: WARNING nova.compute.manager [req-916438c0-0b27-4c32-9093-3e0e9ca48ef5 req-e0a65675-c24d-4664-a75f-68fd283f1f03 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received unexpected event network-vif-plugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb for instance with vm_state building and task_state spawning.
Aug 15 02:09:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065394.9174628, afb831b1-b2b9-4771-a759-47fbaa2a0382 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:09:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] VM Resumed (Lifecycle Event)
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:09:54 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Instance spawned successfully.
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:09:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065394.918785, afb831b1-b2b9-4771-a759-47fbaa2a0382 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:09:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] VM Started (Lifecycle Event)
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:09:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:09:55 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:09:55 user nova-compute[73121]: INFO nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Took 5.41 seconds to spawn the instance on the hypervisor.
Aug 15 02:09:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:09:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdb50e59-fc42-46eb-ba50-b06cedfbbbe1 req-b9d23a3d-6d4a-4b30-856d-886c62a989a9 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received event network-vif-plugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:09:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdb50e59-fc42-46eb-ba50-b06cedfbbbe1 req-b9d23a3d-6d4a-4b30-856d-886c62a989a9 service nova] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:09:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdb50e59-fc42-46eb-ba50-b06cedfbbbe1 req-b9d23a3d-6d4a-4b30-856d-886c62a989a9 service nova] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:09:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdb50e59-fc42-46eb-ba50-b06cedfbbbe1 req-b9d23a3d-6d4a-4b30-856d-886c62a989a9 service nova] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdb50e59-fc42-46eb-ba50-b06cedfbbbe1 req-b9d23a3d-6d4a-4b30-856d-886c62a989a9 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] No waiting events found dispatching network-vif-plugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:09:55 user nova-compute[73121]: WARNING nova.compute.manager [req-cdb50e59-fc42-46eb-ba50-b06cedfbbbe1 req-b9d23a3d-6d4a-4b30-856d-886c62a989a9 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received unexpected event network-vif-plugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb for instance with vm_state building and task_state spawning.
Aug 15 02:09:55 user nova-compute[73121]: INFO nova.compute.manager [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Took 6.14 seconds to build instance.
Aug 15 02:09:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-57abc515-b88d-4617-93b2-95cc0f86ad3e tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.250s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:09:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:09:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:00 user nova-compute[73121]: INFO nova.compute.manager [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Terminating instance
Aug 15 02:10:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-037d0c61-c860-44f5-b3e4-8c8bb158c9ed req-6cd608b0-f438-4767-838c-1e8f17ec88ed service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-037d0c61-c860-44f5-b3e4-8c8bb158c9ed req-6cd608b0-f438-4767-838c-1e8f17ec88ed service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-037d0c61-c860-44f5-b3e4-8c8bb158c9ed req-6cd608b0-f438-4767-838c-1e8f17ec88ed service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-037d0c61-c860-44f5-b3e4-8c8bb158c9ed req-6cd608b0-f438-4767-838c-1e8f17ec88ed service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-037d0c61-c860-44f5-b3e4-8c8bb158c9ed req-6cd608b0-f438-4767-838c-1e8f17ec88ed service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-037d0c61-c860-44f5-b3e4-8c8bb158c9ed req-6cd608b0-f438-4767-838c-1e8f17ec88ed service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-unplugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:10:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Instance destroyed successfully.
Aug 15 02:10:00 user nova-compute[73121]: DEBUG nova.objects.instance [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'resources' on Instance uuid 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-696601170',display_name='tempest-AttachVolumeTestJSON-server-696601170',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-696601170',id=2,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnrHjZP720UW0jo4iit8Pxgel5e+QfHyvMcWZQXiEzUPxi1x+UpLbvVaMujS5PIKUKWw85w6Ks98+VVNHxofUs5EqHpLoyaS82dHgB23+nlXLdzYmwP/5iI0jRjGfKXxQ==',key_name='tempest-keypair-65630828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-xc2jvcst',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:08:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=2c215d73-ebab-4b74-b2a5-a4b5a0264e89,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "896acc02-dd7e-4464-be83-5a9774c03d22", "address": "fa:16:3e:a5:cc:77", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap896acc02-dd", "ovs_interfaceid": "896acc02-dd7e-4464-be83-5a9774c03d22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG os_vif [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap896acc02-dd, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:00 user nova-compute[73121]: INFO os_vif [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:cc:77,bridge_name='br-int',has_traffic_filtering=True,id=896acc02-dd7e-4464-be83-5a9774c03d22,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896acc02-dd')
Aug 15 02:10:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Deleting instance files /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89_del
Aug 15 02:10:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Deletion of /opt/stack/data/nova/instances/2c215d73-ebab-4b74-b2a5-a4b5a0264e89_del complete
Aug 15 02:10:01 user nova-compute[73121]: INFO nova.compute.manager [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 15 02:10:01 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "689cd18c-6031-4971-9505-166b8f7e4217" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "689cd18c-6031-4971-9505-166b8f7e4217" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "689cd18c-6031-4971-9505-166b8f7e4217-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:01 user nova-compute[73121]: INFO nova.compute.manager [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Terminating instance
Aug 15 02:10:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:10:01 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Took 0.84 seconds to deallocate network for instance.
Aug 15 02:10:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-b2179654-32c0-4e5b-8deb-0e1afee8ff65 req-235a1807-8210-4567-ac28-2469dba071dc service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-deleted-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:10:01 user nova-compute[73121]: INFO nova.compute.manager [req-b2179654-32c0-4e5b-8deb-0e1afee8ff65 req-235a1807-8210-4567-ac28-2469dba071dc service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Neutron deleted interface 896acc02-dd7e-4464-be83-5a9774c03d22; detaching it from the instance and deleting it from the info cache
Aug 15 02:10:01 user nova-compute[73121]: DEBUG nova.network.neutron [req-b2179654-32c0-4e5b-8deb-0e1afee8ff65 req-235a1807-8210-4567-ac28-2469dba071dc service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-b2179654-32c0-4e5b-8deb-0e1afee8ff65 req-235a1807-8210-4567-ac28-2469dba071dc service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Detach interface failed, port_id=896acc02-dd7e-4464-be83-5a9774c03d22, reason: Instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:02 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Deleted allocations for instance 2c215d73-ebab-4b74-b2a5-a4b5a0264e89
Aug 15 02:10:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3b094cb6-6ea8-490b-999b-3efed04cf882 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.342s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Instance destroyed successfully.
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'resources' on Instance uuid 689cd18c-6031-4971-9505-166b8f7e4217 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1789092742',display_name='tempest-TestVolumeBootPattern-server-1789092742',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1789092742',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:08:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-uqeslzvc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:08:36Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=689cd18c-6031-4971-9505-166b8f7e4217,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "address": "fa:16:3e:91:29:69", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6b3dfe3a-6d", "ovs_interfaceid": "6b3dfe3a-6de7-42a8-bb45-260efb277b52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:69,bridge_name='br-int',has_traffic_filtering=True,id=6b3dfe3a-6de7-42a8-bb45-260efb277b52,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b3dfe3a-6d') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_vif [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:69,bridge_name='br-int',has_traffic_filtering=True,id=6b3dfe3a-6de7-42a8-bb45-260efb277b52,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b3dfe3a-6d') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.compute.manager [req-05dca7f2-2cf9-43a7-b8d0-f0b1c8ff21f8 req-7ae570b0-955b-4a52-b042-820291e4e2cc service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-05dca7f2-2cf9-43a7-b8d0-f0b1c8ff21f8 req-7ae570b0-955b-4a52-b042-820291e4e2cc service nova] Acquiring lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-05dca7f2-2cf9-43a7-b8d0-f0b1c8ff21f8 req-7ae570b0-955b-4a52-b042-820291e4e2cc service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-05dca7f2-2cf9-43a7-b8d0-f0b1c8ff21f8 req-7ae570b0-955b-4a52-b042-820291e4e2cc service nova] Lock "2c215d73-ebab-4b74-b2a5-a4b5a0264e89-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.compute.manager [req-05dca7f2-2cf9-43a7-b8d0-f0b1c8ff21f8 req-7ae570b0-955b-4a52-b042-820291e4e2cc service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] No waiting events found dispatching network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:10:02 user nova-compute[73121]: WARNING nova.compute.manager [req-05dca7f2-2cf9-43a7-b8d0-f0b1c8ff21f8 req-7ae570b0-955b-4a52-b042-820291e4e2cc service nova] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Received unexpected event network-vif-plugged-896acc02-dd7e-4464-be83-5a9774c03d22 for instance with vm_state deleted and task_state None.
Aug 15 02:10:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6b3dfe3a-6d, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:10:02 user nova-compute[73121]: INFO os_vif [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:69,bridge_name='br-int',has_traffic_filtering=True,id=6b3dfe3a-6de7-42a8-bb45-260efb277b52,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6b3dfe3a-6d')
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nbeNIHcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:10:02 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd7cfa8-613d-4c4e-aaef-84a2ae44bcd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef09fed7-7399-44d1-a38f-de86ff8813c4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:10:02 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:10:02 user nova-compute[73121]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 (non-flash)
Aug 15 02:10:02 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:10:02 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:10:02 user nova-compute[73121]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 (non-flash)
Aug 15 02:10:02 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc60e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1'): ({'sde'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Removing single pathed devices sde {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb53287-2a06-4d4d-b430-8c65d63bb85e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceac57f2-4856-4a47-9592-12195994d63d]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flushing IO for device /dev/sde {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[38869387-f8df-4970-8cf0-4cc8e203a832]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec2646d-3fb8-4825-ab3e-5a57d9d5814e]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[102b8e81-0a69-4281-86a2-8a215d753a29]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c3279a-554b-4b35-a672-3304bf10196c]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1, portal: 172.16.0.220,3260]
Aug 15 02:10:02 user nova-compute[73121]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1, portal: 172.16.0.220,3260] successful.
Aug 15 02:10:02 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa40f920-4b91-456e-bea2-d2dbfcbb6f24]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== disconnect_volume: return (294ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:10:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Deleting instance files /opt/stack/data/nova/instances/689cd18c-6031-4971-9505-166b8f7e4217_del
Aug 15 02:10:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Deletion of /opt/stack/data/nova/instances/689cd18c-6031-4971-9505-166b8f7e4217_del complete
Aug 15 02:10:02 user nova-compute[73121]: INFO nova.compute.manager [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 15 02:10:02 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:10:02 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:10:03 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Took 0.49 seconds to deallocate network for instance.
Aug 15 02:10:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received event network-vif-unplugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] Acquiring lock "689cd18c-6031-4971-9505-166b8f7e4217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] No waiting events found dispatching network-vif-unplugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received event network-vif-unplugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received event network-vif-plugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] Acquiring lock "689cd18c-6031-4971-9505-166b8f7e4217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] Lock "689cd18c-6031-4971-9505-166b8f7e4217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] No waiting events found dispatching network-vif-plugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:10:03 user nova-compute[73121]: WARNING nova.compute.manager [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received unexpected event network-vif-plugged-6b3dfe3a-6de7-42a8-bb45-260efb277b52 for instance with vm_state active and task_state deleting.
Aug 15 02:10:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-ae544293-abf5-4716-b4ce-2c6803537e86 req-6181ab67-8e95-40a6-91a1-054058906680 service nova] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Received event network-vif-deleted-6b3dfe3a-6de7-42a8-bb45-260efb277b52 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:10:04 user nova-compute[73121]: INFO nova.compute.manager [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Took 0.85 seconds to detach 1 volumes for instance.
Aug 15 02:10:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Deleting volume: 33dda2bf-7eb9-4c0d-80f3-f11ce7eb25e1 {{(pid=73121) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 02:10:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:04 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:10:04 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:10:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:04 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Deleted allocations for instance 689cd18c-6031-4971-9505-166b8f7e4217
Aug 15 02:10:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15aefe19-d282-4e87-92b7-8ee0da2b64d1 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "689cd18c-6031-4971-9505-166b8f7e4217" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-aa520b6c-d239-450b-ba9b-30686b89d919 req-1f7c067e-1e7c-4b43-ab53-20a0f058251c service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-changed-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:10:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-aa520b6c-d239-450b-ba9b-30686b89d919 req-1f7c067e-1e7c-4b43-ab53-20a0f058251c service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Refreshing instance network info cache due to event network-changed-eeb90096-6720-4d4b-954c-f03f3eeba489. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:10:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-aa520b6c-d239-450b-ba9b-30686b89d919 req-1f7c067e-1e7c-4b43-ab53-20a0f058251c service nova] Acquiring lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:10:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-aa520b6c-d239-450b-ba9b-30686b89d919 req-1f7c067e-1e7c-4b43-ab53-20a0f058251c service nova] Acquired lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:10:07 user nova-compute[73121]: DEBUG nova.network.neutron [req-aa520b6c-d239-450b-ba9b-30686b89d919 req-1f7c067e-1e7c-4b43-ab53-20a0f058251c service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Refreshing network info cache for port eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:10:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-aa520b6c-d239-450b-ba9b-30686b89d919 req-1f7c067e-1e7c-4b43-ab53-20a0f058251c service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updated VIF entry in instance network info cache for port eeb90096-6720-4d4b-954c-f03f3eeba489. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:10:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-aa520b6c-d239-450b-ba9b-30686b89d919 req-1f7c067e-1e7c-4b43-ab53-20a0f058251c service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating instance_info_cache with network_info: [{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:10:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-aa520b6c-d239-450b-ba9b-30686b89d919 req-1f7c067e-1e7c-4b43-ab53-20a0f058251c service nova] Releasing lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:10:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:10:08 user nova-compute[73121]: INFO nova.compute.manager [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] instance snapshotting
Aug 15 02:10:08 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Beginning live snapshot process
Aug 15 02:10:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json -f qcow2 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json -f qcow2 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json -f qcow2" returned: 0 in 0.232s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7e3jwjjy/aef980e8e07d46f490638a57091c478e.delta 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7e3jwjjy/aef980e8e07d46f490638a57091c478e.delta 1073741824" returned: 0 in 0.049s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:09 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 02:10:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:10:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:10:10 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 02:10:10 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:10:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7e3jwjjy/aef980e8e07d46f490638a57091c478e.delta /opt/stack/data/nova/instances/snapshots/tmp7e3jwjjy/aef980e8e07d46f490638a57091c478e {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7e3jwjjy/aef980e8e07d46f490638a57091c478e.delta /opt/stack/data/nova/instances/snapshots/tmp7e3jwjjy/aef980e8e07d46f490638a57091c478e" returned: 0 in 0.478s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Snapshot extracted, beginning image upload
Aug 15 02:10:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:13 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Snapshot image upload complete
Aug 15 02:10:13 user nova-compute[73121]: INFO nova.compute.manager [None req-712f267b-ba0c-4a3a-ad3b-8572d6e5f0ed tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Took 5.21 seconds to snapshot the instance on the hypervisor.
Aug 15 02:10:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:15 user nova-compute[73121]: INFO nova.compute.manager [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Detaching volume f8699a24-3ce9-4f61-9d09-71b267b78e6d
Aug 15 02:10:15 user nova-compute[73121]: INFO nova.virt.block_device [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Attempting to driver detach volume f8699a24-3ce9-4f61-9d09-71b267b78e6d from mountpoint /dev/vdb
Aug 15 02:10:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Attempting to detach device vdb from instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:10:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:10:15 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:10:15 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:10:15 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:10:15 user nova-compute[73121]:   <serial>f8699a24-3ce9-4f61-9d09-71b267b78e6d</serial>
Aug 15 02:10:15 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:10:15 user nova-compute[73121]: </disk>
Aug 15 02:10:15 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:10:15 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully detached device vdb from instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 from the persistent domain config.
Aug 15 02:10:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:10:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:10:15 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:10:15 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:10:15 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:10:15 user nova-compute[73121]:   <serial>f8699a24-3ce9-4f61-9d09-71b267b78e6d</serial>
Aug 15 02:10:15 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:10:15 user nova-compute[73121]: </disk>
Aug 15 02:10:15 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:10:15 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065400.9205124, 2c215d73-ebab-4b74-b2a5-a4b5a0264e89 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:10:15 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] VM Stopped (Lifecycle Event)
Aug 15 02:10:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-61c3e11c-94c8-453e-b924-28612e77f593 None None] [instance: 2c215d73-ebab-4b74-b2a5-a4b5a0264e89] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065416.0323155, d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:10:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully detached device vdb from instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 from the live domain config.
Aug 15 02:10:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jETIVpHx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:10:16 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b4dafc-bb18-46f7-b4a8-519eee10c5e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1379c151-ab2e-428f-8c86-84859f84e592]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:10:16 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:10:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:10:16 user nova-compute[73121]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d (non-flash)
Aug 15 02:10:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e34be3d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b41938d-46f5-4414-834b-c64bd1623d22]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e61329-72fb-4ca2-838d-c229fbd98fe7]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ec23d7-e60c-4992-b64f-43a32764a39d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95237d4-f94c-46e7-bc96-9d34a68ba653]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eef9d83-a3f1-4578-a24e-db103af8cbcf]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2280280f-c04c-4ae3-ad7a-c1ce7b54880a]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d, portal: 172.16.0.220,3260]
Aug 15 02:10:16 user nova-compute[73121]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d, portal: 172.16.0.220,3260] successful.
Aug 15 02:10:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8699a24-3ce9-4f61-9d09-71b267b78e6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0ee4e6-f849-4d0e-a4e4-c1bdac4b83b2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] <== disconnect_volume: return (278ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:10:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:10:17 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:17 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'flavor' on Instance uuid d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:10:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5e4f212c-e576-4fab-849a-1a06edf1e521 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.709s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:17 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065402.536602, 689cd18c-6031-4971-9505-166b8f7e4217 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:10:17 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] VM Stopped (Lifecycle Event)
Aug 15 02:10:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-68a257fe-ddef-4150-96eb-d83ab34228f9 None None] [instance: 689cd18c-6031-4971-9505-166b8f7e4217] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:10:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:19 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:10:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:10:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:10:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:10:20 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:10:20 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updating instance_info_cache with network_info: [{"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:10:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:10:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:10:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:24 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:10:24 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7597MB free_disk=25.429981231689453GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 012c74eb-e477-42dc-a04e-908b51e82de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7950f28-0893-49de-a560-bbc0791492b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance be6f8247-2be1-4add-92e9-54e4bef5c44c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance afb831b1-b2b9-4771-a759-47fbaa2a0382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:10:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:10:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:10:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:10:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:10:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:10:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:10:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:10:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:10:44 user nova-compute[73121]: INFO nova.compute.manager [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] instance snapshotting
Aug 15 02:10:44 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Beginning live snapshot process
Aug 15 02:10:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json -f qcow2 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json -f qcow2 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsa6f6fib/673d9928142f4df19eb6129331c3ffe0.delta 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsa6f6fib/673d9928142f4df19eb6129331c3ffe0.delta 1073741824" returned: 0 in 0.065s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:45 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 02:10:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:10:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] COPY block job progress, current cursor: 21561344 final cursor: 75497472 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:10:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:10:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 02:10:47 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:10:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsa6f6fib/673d9928142f4df19eb6129331c3ffe0.delta /opt/stack/data/nova/instances/snapshots/tmpsa6f6fib/673d9928142f4df19eb6129331c3ffe0 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsa6f6fib/673d9928142f4df19eb6129331c3ffe0.delta /opt/stack/data/nova/instances/snapshots/tmpsa6f6fib/673d9928142f4df19eb6129331c3ffe0" returned: 0 in 0.460s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:47 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Snapshot extracted, beginning image upload
Aug 15 02:10:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Snapshot image upload complete
Aug 15 02:10:49 user nova-compute[73121]: INFO nova.compute.manager [None req-61a66124-e9ff-4804-adb1-5041c24a7a75 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Took 5.90 seconds to snapshot the instance on the hypervisor.
Aug 15 02:10:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:10:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:10:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:10:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:10:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:10:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:54 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:10:54 user nova-compute[73121]: INFO nova.compute.claims [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Claim successful on node user
Aug 15 02:10:55 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:10:55 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:10:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG nova.policy [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8c555808f8b84962b88920df9f029648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16eb9362b3cd4011b8c7bae927a6edd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:10:55 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Creating image(s)
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "/opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "/opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.199s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk 1073741824" returned: 0 in 0.058s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Successfully created port: ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Cannot resize image /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'migration_context' on Instance uuid a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Ensure instance console log exists: /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Successfully updated port: ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "refresh_cache-a2ba430b-5100-4e64-9311-f5521a432292" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquired lock "refresh_cache-a2ba430b-5100-4e64-9311-f5521a432292" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:10:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.network.neutron [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-f76e8213-9703-47be-820a-85a4bff4513b req-75a7ff8f-a3c5-47bc-a59b-43d8d5301613 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received event network-changed-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-f76e8213-9703-47be-820a-85a4bff4513b req-75a7ff8f-a3c5-47bc-a59b-43d8d5301613 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Refreshing instance network info cache due to event network-changed-ee0a5e67-7879-49b3-a54f-bc66eb6f1631. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f76e8213-9703-47be-820a-85a4bff4513b req-75a7ff8f-a3c5-47bc-a59b-43d8d5301613 service nova] Acquiring lock "refresh_cache-a2ba430b-5100-4e64-9311-f5521a432292" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.network.neutron [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Updating instance_info_cache with network_info: [{"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Releasing lock "refresh_cache-a2ba430b-5100-4e64-9311-f5521a432292" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Instance network_info: |[{"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f76e8213-9703-47be-820a-85a4bff4513b req-75a7ff8f-a3c5-47bc-a59b-43d8d5301613 service nova] Acquired lock "refresh_cache-a2ba430b-5100-4e64-9311-f5521a432292" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.network.neutron [req-f76e8213-9703-47be-820a-85a4bff4513b req-75a7ff8f-a3c5-47bc-a59b-43d8d5301613 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Refreshing network info cache for port ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Start _get_guest_xml network_info=[{"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:10:57 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:10:57 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1455572834',display_name='tempest-AttachVolumeTestJSON-server-1455572834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1455572834',id=27,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc+b4X0Y543gJA00QNYcOSjTxylIvvS11BMHQ15lzKw1VFbRLqvraCp4cJa2MckGdCUh/mTfZ+oG7sKqqgTZ7/EY/UzYuGlNgSIHDl8FndbrUqD5lYksKQ89etNBFPXsw==',key_name='tempest-keypair-1834838872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-07ksgkrp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=a2ba430b-5100-4e64-9311-f5521a432292,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=ee0a5e67-7879-49b3-a54f-bc66eb6f1631,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0a5e67-78') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.objects.instance [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'pci_devices' on Instance uuid a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:10:57 user nova-compute[73121]:   <uuid>a2ba430b-5100-4e64-9311-f5521a432292</uuid>
Aug 15 02:10:57 user nova-compute[73121]:   <name>instance-0000001b</name>
Aug 15 02:10:57 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:10:57 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:10:57 user nova-compute[73121]:   <metadata>
Aug 15 02:10:57 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:10:57 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:10:57 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeTestJSON-server-1455572834</nova:name>
Aug 15 02:10:57 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:10:57</nova:creationTime>
Aug 15 02:10:57 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:10:57 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:10:57 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:10:57 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:10:57 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:10:57 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:10:57 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:10:57 user nova-compute[73121]:       <nova:owner>
Aug 15 02:10:57 user nova-compute[73121]:         <nova:user uuid="8c555808f8b84962b88920df9f029648">tempest-AttachVolumeTestJSON-1774938081-project-member</nova:user>
Aug 15 02:10:57 user nova-compute[73121]:         <nova:project uuid="16eb9362b3cd4011b8c7bae927a6edd6">tempest-AttachVolumeTestJSON-1774938081</nova:project>
Aug 15 02:10:57 user nova-compute[73121]:       </nova:owner>
Aug 15 02:10:57 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:10:57 user nova-compute[73121]:       <nova:ports>
Aug 15 02:10:57 user nova-compute[73121]:         <nova:port uuid="ee0a5e67-7879-49b3-a54f-bc66eb6f1631">
Aug 15 02:10:57 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 02:10:57 user nova-compute[73121]:         </nova:port>
Aug 15 02:10:57 user nova-compute[73121]:       </nova:ports>
Aug 15 02:10:57 user nova-compute[73121]:     </nova:instance>
Aug 15 02:10:57 user nova-compute[73121]:   </metadata>
Aug 15 02:10:57 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:10:57 user nova-compute[73121]:     <system>
Aug 15 02:10:57 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:10:57 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:10:57 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:10:57 user nova-compute[73121]:       <entry name="serial">a2ba430b-5100-4e64-9311-f5521a432292</entry>
Aug 15 02:10:57 user nova-compute[73121]:       <entry name="uuid">a2ba430b-5100-4e64-9311-f5521a432292</entry>
Aug 15 02:10:57 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:10:57 user nova-compute[73121]:     </system>
Aug 15 02:10:57 user nova-compute[73121]:   </sysinfo>
Aug 15 02:10:57 user nova-compute[73121]:   <os>
Aug 15 02:10:57 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:10:57 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:10:57 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:10:57 user nova-compute[73121]:   </os>
Aug 15 02:10:57 user nova-compute[73121]:   <features>
Aug 15 02:10:57 user nova-compute[73121]:     <acpi/>
Aug 15 02:10:57 user nova-compute[73121]:     <apic/>
Aug 15 02:10:57 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:10:57 user nova-compute[73121]:   </features>
Aug 15 02:10:57 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:10:57 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:10:57 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:10:57 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:10:57 user nova-compute[73121]:   </clock>
Aug 15 02:10:57 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:10:57 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:10:57 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:10:57 user nova-compute[73121]:   </cpu>
Aug 15 02:10:57 user nova-compute[73121]:   <devices>
Aug 15 02:10:57 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:10:57 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:10:57 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk"/>
Aug 15 02:10:57 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:10:57 user nova-compute[73121]:     </disk>
Aug 15 02:10:57 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:10:57 user nova-compute[73121]:       <mac address="fa:16:3e:0d:7f:71"/>
Aug 15 02:10:57 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:10:57 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:10:57 user nova-compute[73121]:       <target dev="tapee0a5e67-78"/>
Aug 15 02:10:57 user nova-compute[73121]:     </interface>
Aug 15 02:10:57 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:10:57 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/console.log" append="off"/>
Aug 15 02:10:57 user nova-compute[73121]:     </serial>
Aug 15 02:10:57 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:10:57 user nova-compute[73121]:     <video>
Aug 15 02:10:57 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:10:57 user nova-compute[73121]:     </video>
Aug 15 02:10:57 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:10:57 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:10:57 user nova-compute[73121]:     </rng>
Aug 15 02:10:57 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:10:57 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:10:57 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:10:57 user nova-compute[73121]:     </memballoon>
Aug 15 02:10:57 user nova-compute[73121]:   </devices>
Aug 15 02:10:57 user nova-compute[73121]: </domain>
Aug 15 02:10:57 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1455572834',display_name='tempest-AttachVolumeTestJSON-server-1455572834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1455572834',id=27,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc+b4X0Y543gJA00QNYcOSjTxylIvvS11BMHQ15lzKw1VFbRLqvraCp4cJa2MckGdCUh/mTfZ+oG7sKqqgTZ7/EY/UzYuGlNgSIHDl8FndbrUqD5lYksKQ89etNBFPXsw==',key_name='tempest-keypair-1834838872',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-07ksgkrp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:10:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=a2ba430b-5100-4e64-9311-f5521a432292,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=ee0a5e67-7879-49b3-a54f-bc66eb6f1631,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0a5e67-78') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG os_vif [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=ee0a5e67-7879-49b3-a54f-bc66eb6f1631,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0a5e67-78') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee0a5e67-78, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee0a5e67-78, col_values=(('external_ids', {'iface-id': 'ee0a5e67-7879-49b3-a54f-bc66eb6f1631', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:7f:71', 'vm-uuid': 'a2ba430b-5100-4e64-9311-f5521a432292'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:57 user nova-compute[73121]: INFO os_vif [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=ee0a5e67-7879-49b3-a54f-bc66eb6f1631,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0a5e67-78')
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No VIF found with MAC fa:16:3e:0d:7f:71, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.network.neutron [req-f76e8213-9703-47be-820a-85a4bff4513b req-75a7ff8f-a3c5-47bc-a59b-43d8d5301613 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Updated VIF entry in instance network info cache for port ee0a5e67-7879-49b3-a54f-bc66eb6f1631. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG nova.network.neutron [req-f76e8213-9703-47be-820a-85a4bff4513b req-75a7ff8f-a3c5-47bc-a59b-43d8d5301613 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Updating instance_info_cache with network_info: [{"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:10:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f76e8213-9703-47be-820a-85a4bff4513b req-75a7ff8f-a3c5-47bc-a59b-43d8d5301613 service nova] Releasing lock "refresh_cache-a2ba430b-5100-4e64-9311-f5521a432292" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:10:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-c9857f63-2fad-4865-b8d9-d97bfd321cc1 req-32046807-feb7-4d05-abc8-1c0deee4d0a7 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received event network-vif-plugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:10:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c9857f63-2fad-4865-b8d9-d97bfd321cc1 req-32046807-feb7-4d05-abc8-1c0deee4d0a7 service nova] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:10:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c9857f63-2fad-4865-b8d9-d97bfd321cc1 req-32046807-feb7-4d05-abc8-1c0deee4d0a7 service nova] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:10:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c9857f63-2fad-4865-b8d9-d97bfd321cc1 req-32046807-feb7-4d05-abc8-1c0deee4d0a7 service nova] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:10:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-c9857f63-2fad-4865-b8d9-d97bfd321cc1 req-32046807-feb7-4d05-abc8-1c0deee4d0a7 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] No waiting events found dispatching network-vif-plugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:10:59 user nova-compute[73121]: WARNING nova.compute.manager [req-c9857f63-2fad-4865-b8d9-d97bfd321cc1 req-32046807-feb7-4d05-abc8-1c0deee4d0a7 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received unexpected event network-vif-plugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 for instance with vm_state building and task_state spawning.
Aug 15 02:10:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:10:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-05a681c2-0a35-421c-a036-b7031416ae5c req-84a9c865-d5d9-4c21-b586-7de4d365ac68 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received event network-vif-plugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-05a681c2-0a35-421c-a036-b7031416ae5c req-84a9c865-d5d9-4c21-b586-7de4d365ac68 service nova] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-05a681c2-0a35-421c-a036-b7031416ae5c req-84a9c865-d5d9-4c21-b586-7de4d365ac68 service nova] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-05a681c2-0a35-421c-a036-b7031416ae5c req-84a9c865-d5d9-4c21-b586-7de4d365ac68 service nova] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-05a681c2-0a35-421c-a036-b7031416ae5c req-84a9c865-d5d9-4c21-b586-7de4d365ac68 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] No waiting events found dispatching network-vif-plugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:01 user nova-compute[73121]: WARNING nova.compute.manager [req-05a681c2-0a35-421c-a036-b7031416ae5c req-84a9c865-d5d9-4c21-b586-7de4d365ac68 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received unexpected event network-vif-plugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 for instance with vm_state building and task_state spawning.
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065461.452253, a2ba430b-5100-4e64-9311-f5521a432292 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:01 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a2ba430b-5100-4e64-9311-f5521a432292] VM Resumed (Lifecycle Event)
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:11:01 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Instance spawned successfully.
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:01 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a2ba430b-5100-4e64-9311-f5521a432292] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065461.4559195, a2ba430b-5100-4e64-9311-f5521a432292 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:01 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a2ba430b-5100-4e64-9311-f5521a432292] VM Started (Lifecycle Event)
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:11:01 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a2ba430b-5100-4e64-9311-f5521a432292] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:11:01 user nova-compute[73121]: INFO nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Took 6.16 seconds to spawn the instance on the hypervisor.
Aug 15 02:11:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:01 user nova-compute[73121]: INFO nova.compute.manager [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Took 6.97 seconds to build instance.
Aug 15 02:11:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-78fd3cb7-d8a1-4f03-af2b-1aee766de269 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.150s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'flavor' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:03 user nova-compute[73121]: INFO nova.compute.manager [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Attaching volume bd74c2bc-2cc4-44dd-8da3-e578c6de9791 to /dev/vdb
Aug 15 02:11:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-55f72a3a-7631-4a73-b57a-f55a03cf352a req-1c5673ee-1f58-49c5-b550-02c09344ced9 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-changed-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-55f72a3a-7631-4a73-b57a-f55a03cf352a req-1c5673ee-1f58-49c5-b550-02c09344ced9 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Refreshing instance network info cache due to event network-changed-5cff72bc-b5f5-4ac2-a334-0672a871e44b. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-55f72a3a-7631-4a73-b57a-f55a03cf352a req-1c5673ee-1f58-49c5-b550-02c09344ced9 service nova] Acquiring lock "refresh_cache-be6f8247-2be1-4add-92e9-54e4bef5c44c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-55f72a3a-7631-4a73-b57a-f55a03cf352a req-1c5673ee-1f58-49c5-b550-02c09344ced9 service nova] Acquired lock "refresh_cache-be6f8247-2be1-4add-92e9-54e4bef5c44c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG nova.network.neutron [req-55f72a3a-7631-4a73-b57a-f55a03cf352a req-1c5673ee-1f58-49c5-b550-02c09344ced9 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Refreshing network info cache for port 5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG os_brick.utils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3907376-f3eb-46c8-84fe-6d404e584980]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92a9827-60fd-4a8d-b8f0-d7aff4f1aac1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.178s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d168bc64-9ab6-452e-bcb8-9255726e9985]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d9b1aa-a8c3-456d-984f-fdc724a7be82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:11:03 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:11:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[44458451-cab9-4ce1-bdfb-d7a24d35239e]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG os_brick.utils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== get_connector_properties: return (324ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:11:03 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Updating existing volume attachment record: 8df38eaf-b4b0-443f-8289-dc9abac57760 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:11:04 user nova-compute[73121]: DEBUG nova.network.neutron [req-55f72a3a-7631-4a73-b57a-f55a03cf352a req-1c5673ee-1f58-49c5-b550-02c09344ced9 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Updated VIF entry in instance network info cache for port 5cff72bc-b5f5-4ac2-a334-0672a871e44b. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:11:04 user nova-compute[73121]: DEBUG nova.network.neutron [req-55f72a3a-7631-4a73-b57a-f55a03cf352a req-1c5673ee-1f58-49c5-b550-02c09344ced9 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Updating instance_info_cache with network_info: [{"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-55f72a3a-7631-4a73-b57a-f55a03cf352a req-1c5673ee-1f58-49c5-b550-02c09344ced9 service nova] Releasing lock "refresh_cache-be6f8247-2be1-4add-92e9-54e4bef5c44c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:06 user nova-compute[73121]: INFO nova.compute.manager [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Terminating instance
Aug 15 02:11:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-73a836f1-ff9e-4f5f-a136-328b57701aaf req-48d3075e-2be7-40cb-925d-cfd56f02a9ba service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received event network-vif-unplugged-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-73a836f1-ff9e-4f5f-a136-328b57701aaf req-48d3075e-2be7-40cb-925d-cfd56f02a9ba service nova] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-73a836f1-ff9e-4f5f-a136-328b57701aaf req-48d3075e-2be7-40cb-925d-cfd56f02a9ba service nova] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-73a836f1-ff9e-4f5f-a136-328b57701aaf req-48d3075e-2be7-40cb-925d-cfd56f02a9ba service nova] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-73a836f1-ff9e-4f5f-a136-328b57701aaf req-48d3075e-2be7-40cb-925d-cfd56f02a9ba service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] No waiting events found dispatching network-vif-unplugged-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-73a836f1-ff9e-4f5f-a136-328b57701aaf req-48d3075e-2be7-40cb-925d-cfd56f02a9ba service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received event network-vif-unplugged-078c1390-48c5-4a7f-8888-804e5ff491f7 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:11:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Instance destroyed successfully.
Aug 15 02:11:07 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'resources' on Instance uuid d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:05:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-567986943',display_name='tempest-AttachVolumeNegativeTest-server-567986943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-567986943',id=17,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuu5xrWB2IYPqqFD1PXu6xS4ba+afNykvt5/cQRPg9Ug8NypFv+BZ1Edcg5SGrqqAZ+4N6s/OiMnD2baFX3i5dYXK4eEwNclWoA8r9smhMbAoz1pdM6HPpvqFQes/0kiQ==',key_name='tempest-keypair-1393288261',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:05:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-r71aug21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:05:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "078c1390-48c5-4a7f-8888-804e5ff491f7", "address": "fa:16:3e:2f:4a:cf", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap078c1390-48", "ovs_interfaceid": "078c1390-48c5-4a7f-8888-804e5ff491f7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=078c1390-48c5-4a7f-8888-804e5ff491f7,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078c1390-48') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG os_vif [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=078c1390-48c5-4a7f-8888-804e5ff491f7,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078c1390-48') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap078c1390-48, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:11:07 user nova-compute[73121]: INFO os_vif [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:4a:cf,bridge_name='br-int',has_traffic_filtering=True,id=078c1390-48c5-4a7f-8888-804e5ff491f7,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap078c1390-48')
Aug 15 02:11:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Deleting instance files /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66_del
Aug 15 02:11:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Deletion of /opt/stack/data/nova/instances/d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66_del complete
Aug 15 02:11:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 15 02:11:07 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:11:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:08 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-c9672374-240d-470c-9b7a-d6469c362b6f req-6b7b1e2e-f224-4579-859a-53c32f266384 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received event network-vif-deleted-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:08 user nova-compute[73121]: INFO nova.compute.manager [req-c9672374-240d-470c-9b7a-d6469c362b6f req-6b7b1e2e-f224-4579-859a-53c32f266384 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Neutron deleted interface 078c1390-48c5-4a7f-8888-804e5ff491f7; detaching it from the instance and deleting it from the info cache
Aug 15 02:11:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-c9672374-240d-470c-9b7a-d6469c362b6f req-6b7b1e2e-f224-4579-859a-53c32f266384 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:08 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Took 1.30 seconds to deallocate network for instance.
Aug 15 02:11:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-c9672374-240d-470c-9b7a-d6469c362b6f req-6b7b1e2e-f224-4579-859a-53c32f266384 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Detach interface failed, port_id=078c1390-48c5-4a7f-8888-804e5ff491f7, reason: Instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:11:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-211d5f2f-2b29-4a33-87ad-2aa541e3f027 req-f7c2d1b2-e66c-4b7e-94e7-c5cf4fd05253 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received event network-vif-plugged-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-211d5f2f-2b29-4a33-87ad-2aa541e3f027 req-f7c2d1b2-e66c-4b7e-94e7-c5cf4fd05253 service nova] Acquiring lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-211d5f2f-2b29-4a33-87ad-2aa541e3f027 req-f7c2d1b2-e66c-4b7e-94e7-c5cf4fd05253 service nova] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-211d5f2f-2b29-4a33-87ad-2aa541e3f027 req-f7c2d1b2-e66c-4b7e-94e7-c5cf4fd05253 service nova] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-211d5f2f-2b29-4a33-87ad-2aa541e3f027 req-f7c2d1b2-e66c-4b7e-94e7-c5cf4fd05253 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] No waiting events found dispatching network-vif-plugged-078c1390-48c5-4a7f-8888-804e5ff491f7 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:08 user nova-compute[73121]: WARNING nova.compute.manager [req-211d5f2f-2b29-4a33-87ad-2aa541e3f027 req-f7c2d1b2-e66c-4b7e-94e7-c5cf4fd05253 service nova] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Received unexpected event network-vif-plugged-078c1390-48c5-4a7f-8888-804e5ff491f7 for instance with vm_state deleted and task_state None.
Aug 15 02:11:09 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:11:09 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:11:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:09 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Deleted allocations for instance d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66
Aug 15 02:11:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce9d1dfa-0fdc-40f3-ab64-64c80585a9dc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.243s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "00d2c851-39b9-40cb-8bac-785c954800cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "00d2c851-39b9-40cb-8bac-785c954800cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:11:17 user nova-compute[73121]: INFO nova.compute.claims [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Claim successful on node user
Aug 15 02:11:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:11:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:11:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:11:17 user nova-compute[73121]: INFO nova.virt.block_device [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Booting with volume 71530332-680c-4ff4-989e-f81f0f1b9757 at /dev/vda
Aug 15 02:11:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG os_brick.utils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8411a-3b74-4d02-bd53-7df911119bdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[955f6f69-3e66-4825-9622-fb1448968125]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG nova.policy [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f9c4f2ffebb440cb88132a502d51811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3397dd14ca44c19dc4386aec30a9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63ff5c8-4bec-40d0-a152-47b7a3715acb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f0785-3777-40ba-a5ef-b2db42d8cf5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:11:17 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:11:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c07f656-314d-4ab6-87d3-f93af3defb24]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG os_brick.utils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:11:17 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Updating existing volume attachment record: 5ef1cb93-00b3-4442-9949-6bf97ac9f9e4 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:11:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:11:19 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Successfully created port: 6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHTMVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:11:20 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:11:20 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:11:20 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d056a0a1-6699-4327-a1a4-b6154f5e0d0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:11:20 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0912bc77-c372-41c4-a863-84c52a7c672e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791] added
Aug 15 02:11:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d369e9ec-c15b-4a77-84c6-ec4f7ff709aa]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f5524-c9d8-4e49-87ad-931b1c791b53]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWFHTMVs {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWFHTMVs" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a62f1f-86f1-4f82-a0ca-8636e79544bf]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWFHTMVs'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1686b4cc-5c24-4abb-989f-00330af3d027]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc75bb7-d101-435b-a248-6e6a231b90e9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[01114f92-2d1d-479d-9344-013c333fc113]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260]
Aug 15 02:11:20 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260] successful.
Aug 15 02:11:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[874bff39-7193-427e-94a5-08cc3b9df9d6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7efc776-57b1-41b7-a7de-86c99b27fbcc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:20 user nova-compute[73121]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:11:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:20 user nova-compute[73121]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:11:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d75ad4e-6a26-458f-83cf-fb2fee832d68]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:11:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Successfully updated port: 6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHTMVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26633646161623666', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633646161623666', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.compute.manager [req-1109d472-9e56-49bb-99a0-0f21388e7062 req-ad697910-6c73-4ef9-b16d-b830b974cb09 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received event network-changed-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.compute.manager [req-1109d472-9e56-49bb-99a0-0f21388e7062 req-ad697910-6c73-4ef9-b16d-b830b974cb09 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Refreshing instance network info cache due to event network-changed-6cbc95d3-e345-4927-9abb-8e38f739af02. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1109d472-9e56-49bb-99a0-0f21388e7062 req-ad697910-6c73-4ef9-b16d-b830b974cb09 service nova] Acquiring lock "refresh_cache-00d2c851-39b9-40cb-8bac-785c954800cf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1109d472-9e56-49bb-99a0-0f21388e7062 req-ad697910-6c73-4ef9-b16d-b830b974cb09 service nova] Acquired lock "refresh_cache-00d2c851-39b9-40cb-8bac-785c954800cf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.network.neutron [req-1109d472-9e56-49bb-99a0-0f21388e7062 req-ad697910-6c73-4ef9-b16d-b830b974cb09 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Refreshing network info cache for port 6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'flavor' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "refresh_cache-00d2c851-39b9-40cb-8bac-785c954800cf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:11:21 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:11:21 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:11:21 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:11:21 user nova-compute[73121]:   <serial>bd74c2bc-2cc4-44dd-8da3-e578c6de9791</serial>
Aug 15 02:11:21 user nova-compute[73121]: </disk>
Aug 15 02:11:21 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.network.neutron [req-1109d472-9e56-49bb-99a0-0f21388e7062 req-ad697910-6c73-4ef9-b16d-b830b974cb09 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:11:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No VIF found with MAC fa:16:3e:28:50:2c, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065467.014031, d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:22 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] VM Stopped (Lifecycle Event)
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-831f756b-b266-4e74-908b-403b265b0a0c None None] [instance: d94b39b6-f39c-4c33-ab3e-8f01c7f8fd66] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.network.neutron [req-1109d472-9e56-49bb-99a0-0f21388e7062 req-ad697910-6c73-4ef9-b16d-b830b974cb09 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0fcba5c8-cdb5-4bc1-8b29-26fe00402bfa tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.600s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1109d472-9e56-49bb-99a0-0f21388e7062 req-ad697910-6c73-4ef9-b16d-b830b974cb09 service nova] Releasing lock "refresh_cache-00d2c851-39b9-40cb-8bac-785c954800cf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquired lock "refresh_cache-00d2c851-39b9-40cb-8bac-785c954800cf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Updating instance_info_cache with network_info: [{"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Releasing lock "refresh_cache-00d2c851-39b9-40cb-8bac-785c954800cf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Instance network_info: |[{"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:22 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:23 user nova-compute[73121]: INFO nova.compute.manager [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Rebuilding instance
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'trusted_certs' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'pci_requests' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'pci_devices' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'resources' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'migration_context' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73121) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:11:25 user nova-compute[73121]: INFO nova.compute.claims [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Claim successful on node user
Aug 15 02:11:25 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Instance destroyed successfully.
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:11:25 user nova-compute[73121]: INFO nova.compute.manager [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Detaching volume bd74c2bc-2cc4-44dd-8da3-e578c6de9791
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:11:25 user nova-compute[73121]: INFO nova.virt.block_device [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Attempting to driver detach volume bd74c2bc-2cc4-44dd-8da3-e578c6de9791 from mountpoint /dev/vdb
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Attempting to detach device vdb from instance be6f8247-2be1-4add-92e9-54e4bef5c44c from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:11:25 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:11:25 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:11:25 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:11:25 user nova-compute[73121]:   <serial>bd74c2bc-2cc4-44dd-8da3-e578c6de9791</serial>
Aug 15 02:11:25 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:11:25 user nova-compute[73121]: </disk>
Aug 15 02:11:25 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:11:25 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully detached device vdb from instance be6f8247-2be1-4add-92e9-54e4bef5c44c from the persistent domain config.
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHTMVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:11:25 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b7ea6-00bd-48a5-82ee-211c24016d4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b2548f-8700-4186-97b8-cef75286d175]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:25 user nova-compute[73121]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:11:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:25 user nova-compute[73121]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:11:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc78c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[14295e0d-8905-4ec0-b2d6-56c0090fb8d0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aff01f4-7ea3-4814-b418-0277660095a3]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f54da21-3f58-43a4-ade2-e17dc163b7e0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4450dc-eca1-443e-8e7e-052a305b12c4]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eddda1-211f-4241-b454-af29ed576c9c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e5ea2f-43ac-43b4-847c-d5423533898e]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260]
Aug 15 02:11:25 user nova-compute[73121]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260] successful.
Aug 15 02:11:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2586a63-b964-4f3b-9707-a76e9bd929fb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== disconnect_volume: return (329ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.760s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:11:25 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:11:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG nova.policy [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3992e0609efb4ad389253810ab9b0d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b3c8eef30d43d98388840e389efc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:11:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Creating image(s)
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "/opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "/opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "52e48a2b34ef85767038d637d0ac996a8663421e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "52e48a2b34ef85767038d637d0ac996a8663421e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.806s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e.part --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:26 user nova-compute[73121]: DEBUG nova.virt.images [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] 93d97bf5-b392-4cc3-b28f-86cb5a52e660 was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e.part /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Successfully created port: c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e.part /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e.converted" returned: 0 in 0.658s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-e3bdcc69-7bf9-4962-a25b-d8b5a3daafd5 req-50f1a7a4-ecbd-4a9c-8248-5bb09c96da39 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-unplugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e3bdcc69-7bf9-4962-a25b-d8b5a3daafd5 req-50f1a7a4-ecbd-4a9c-8248-5bb09c96da39 service nova] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e3bdcc69-7bf9-4962-a25b-d8b5a3daafd5 req-50f1a7a4-ecbd-4a9c-8248-5bb09c96da39 service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e3bdcc69-7bf9-4962-a25b-d8b5a3daafd5 req-50f1a7a4-ecbd-4a9c-8248-5bb09c96da39 service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-e3bdcc69-7bf9-4962-a25b-d8b5a3daafd5 req-50f1a7a4-ecbd-4a9c-8248-5bb09c96da39 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] No waiting events found dispatching network-vif-unplugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:27 user nova-compute[73121]: WARNING nova.compute.manager [req-e3bdcc69-7bf9-4962-a25b-d8b5a3daafd5 req-50f1a7a4-ecbd-4a9c-8248-5bb09c96da39 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received unexpected event network-vif-unplugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b for instance with vm_state active and task_state rebuilding.
Aug 15 02:11:27 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:11:27 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.36396026611328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "52e48a2b34ef85767038d637d0ac996a8663421e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.792s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 012c74eb-e477-42dc-a04e-908b51e82de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7950f28-0893-49de-a560-bbc0791492b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance be6f8247-2be1-4add-92e9-54e4bef5c44c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance afb831b1-b2b9-4771-a759-47fbaa2a0382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a2ba430b-5100-4e64-9311-f5521a432292 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 00d2c851-39b9-40cb-8bac-785c954800cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance bc351c09-798d-4048-b80f-0dbf85344edb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:11:27 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:11:28 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Creating image(s)
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Ensure instance console log exists: /opt/stack/data/nova/instances/00d2c851-39b9-40cb-8bac-785c954800cf/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Start _get_guest_xml network_info=[{"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '5ef1cb93-00b3-4442-9949-6bf97ac9f9e4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWNwGVjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00d2c851-39b9-40cb-8bac-785c954800cf', 'attached_at': '', 'detached_at': '', 'volume_id': '71530332-680c-4ff4-989e-f81f0f1b9757', 'serial': '71530332-680c-4ff4-989e-f81f0f1b9757'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:11:28 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:11:28 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWNwGVjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:11:28 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:11:28 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:11:28 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec276c3c-50de-4758-84d4-659ef504772e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:11:28 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "52e48a2b34ef85767038d637d0ac996a8663421e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "52e48a2b34ef85767038d637d0ac996a8663421e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[789f9b3c-4a5f-4e74-99d1-9351ffe78480]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757] added
Aug 15 02:11:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae27581-d681-427e-991a-2a81c40223dc]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2631f748-c91c-429f-83a0-708dceb55c34]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWNwGVjH {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rWNwGVjH" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[34431515-073f-46d6-b7d5-d5a5e429cb66]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rWNwGVjH'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c00e339-7d1a-4eb4-8132-a80cda790a5a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fee736-9582-4f6c-9d1c-4c2d8970d64e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e --force-share --output=json" returned: 0 in 0.199s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e,backing_fmt=raw /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0960ad08-b66e-4810-bd36-0cf23f6407f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757, portal: 172.16.0.220,3260]
Aug 15 02:11:28 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757, portal: 172.16.0.220,3260] successful.
Aug 15 02:11:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e,backing_fmt=raw /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk 1073741824" returned: 0 in 0.066s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "52e48a2b34ef85767038d637d0ac996a8663421e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8575f726-de31-4a5d-ac0c-cfed9e7139c1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aa63a4-ba27-45da-81e2-671584f56d48]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:28 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:11:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:28 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:11:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bca6eb-b9ad-4b91-a612-63af0e96c837]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWNwGVjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.747s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e --force-share --output=json" returned: 0 in 0.212s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Successfully updated port: c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquired lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Cannot resize image /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'migration_context' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Ensure instance console log exists: /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-16dc732b-0b5b-4f94-accd-c38117c69b97 req-7cfe364a-7fc2-471e-8963-cd950bc41ef8 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-16dc732b-0b5b-4f94-accd-c38117c69b97 req-7cfe364a-7fc2-471e-8963-cd950bc41ef8 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing instance network info cache due to event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:11:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-16dc732b-0b5b-4f94-accd-c38117c69b97 req-7cfe364a-7fc2-471e-8963-cd950bc41ef8 service nova] Acquiring lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updating instance_info_cache with network_info: [{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Releasing lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Instance network_info: |[{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-16dc732b-0b5b-4f94-accd-c38117c69b97 req-7cfe364a-7fc2-471e-8963-cd950bc41ef8 service nova] Acquired lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.neutron [req-16dc732b-0b5b-4f94-accd-c38117c69b97 req-7cfe364a-7fc2-471e-8963-cd950bc41ef8 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Start _get_guest_xml network_info=[{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T02:11:22Z,direct_url=<?>,disk_format='qcow2',id=93d97bf5-b392-4cc3-b28f-86cb5a52e660,min_disk=0,min_ram=0,name='tempest-scenario-img--1839281391',owner='b1b3c8eef30d43d98388840e389efc24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T02:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '93d97bf5-b392-4cc3-b28f-86cb5a52e660'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:11:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T02:11:22Z,direct_url=<?>,disk_format='qcow2',id=93d97bf5-b392-4cc3-b28f-86cb5a52e660,min_disk=0,min_ram=0,name='tempest-scenario-img--1839281391',owner='b1b3c8eef30d43d98388840e389efc24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T02:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724694426',display_name='tempest-TestMinimumBasicScenario-server-724694426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724694426',id=29,image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCv5wrOyrsFzl86DFGNOG2qdwU+l5stRjEuUFkXpORmxvzfKrk++1H0yJTS3sm8eXOfrl9ikhygtF+mYZYN2XmCBxEnWJzDHLcDUktCk2f1cZunA4iBo3k4IL4842am+Nw==',key_name='tempest-TestMinimumBasicScenario-2078449806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3c8eef30d43d98388840e389efc24',ramdisk_id='',reservation_id='r-26nhe67r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2011934660',owner_user_name='tempest-TestMinimumBasicScenario-2011934660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:11:26Z,user_data=None,user_id='3992e0609efb4ad389253810ab9b0d33',uuid=bc351c09-798d-4048-b80f-0dbf85344edb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converting VIF {"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'pci_devices' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:11:29 user nova-compute[73121]:   <uuid>bc351c09-798d-4048-b80f-0dbf85344edb</uuid>
Aug 15 02:11:29 user nova-compute[73121]:   <name>instance-0000001d</name>
Aug 15 02:11:29 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:11:29 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:11:29 user nova-compute[73121]:   <metadata>
Aug 15 02:11:29 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:11:29 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:name>tempest-TestMinimumBasicScenario-server-724694426</nova:name>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:11:29</nova:creationTime>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:11:29 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:11:29 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:owner>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:user uuid="3992e0609efb4ad389253810ab9b0d33">tempest-TestMinimumBasicScenario-2011934660-project-member</nova:user>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:project uuid="b1b3c8eef30d43d98388840e389efc24">tempest-TestMinimumBasicScenario-2011934660</nova:project>
Aug 15 02:11:29 user nova-compute[73121]:       </nova:owner>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:root type="image" uuid="93d97bf5-b392-4cc3-b28f-86cb5a52e660"/>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:ports>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:port uuid="c315ab1b-2e05-4e8b-a995-849f3cb9249b">
Aug 15 02:11:29 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:11:29 user nova-compute[73121]:         </nova:port>
Aug 15 02:11:29 user nova-compute[73121]:       </nova:ports>
Aug 15 02:11:29 user nova-compute[73121]:     </nova:instance>
Aug 15 02:11:29 user nova-compute[73121]:   </metadata>
Aug 15 02:11:29 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:11:29 user nova-compute[73121]:     <system>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="serial">bc351c09-798d-4048-b80f-0dbf85344edb</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="uuid">bc351c09-798d-4048-b80f-0dbf85344edb</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:11:29 user nova-compute[73121]:     </system>
Aug 15 02:11:29 user nova-compute[73121]:   </sysinfo>
Aug 15 02:11:29 user nova-compute[73121]:   <os>
Aug 15 02:11:29 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:11:29 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:11:29 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:11:29 user nova-compute[73121]:   </os>
Aug 15 02:11:29 user nova-compute[73121]:   <features>
Aug 15 02:11:29 user nova-compute[73121]:     <acpi/>
Aug 15 02:11:29 user nova-compute[73121]:     <apic/>
Aug 15 02:11:29 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:11:29 user nova-compute[73121]:   </features>
Aug 15 02:11:29 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:11:29 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:11:29 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:11:29 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:11:29 user nova-compute[73121]:   </clock>
Aug 15 02:11:29 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:11:29 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:11:29 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:11:29 user nova-compute[73121]:   </cpu>
Aug 15 02:11:29 user nova-compute[73121]:   <devices>
Aug 15 02:11:29 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:11:29 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:11:29 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk"/>
Aug 15 02:11:29 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:11:29 user nova-compute[73121]:     </disk>
Aug 15 02:11:29 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:11:29 user nova-compute[73121]:       <mac address="fa:16:3e:cb:f3:fa"/>
Aug 15 02:11:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:11:29 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:11:29 user nova-compute[73121]:       <target dev="tapc315ab1b-2e"/>
Aug 15 02:11:29 user nova-compute[73121]:     </interface>
Aug 15 02:11:29 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:11:29 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/console.log" append="off"/>
Aug 15 02:11:29 user nova-compute[73121]:     </serial>
Aug 15 02:11:29 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:11:29 user nova-compute[73121]:     <video>
Aug 15 02:11:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:11:29 user nova-compute[73121]:     </video>
Aug 15 02:11:29 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:11:29 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:11:29 user nova-compute[73121]:     </rng>
Aug 15 02:11:29 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:11:29 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:11:29 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:11:29 user nova-compute[73121]:     </memballoon>
Aug 15 02:11:29 user nova-compute[73121]:   </devices>
Aug 15 02:11:29 user nova-compute[73121]: </domain>
Aug 15 02:11:29 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724694426',display_name='tempest-TestMinimumBasicScenario-server-724694426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724694426',id=29,image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCv5wrOyrsFzl86DFGNOG2qdwU+l5stRjEuUFkXpORmxvzfKrk++1H0yJTS3sm8eXOfrl9ikhygtF+mYZYN2XmCBxEnWJzDHLcDUktCk2f1cZunA4iBo3k4IL4842am+Nw==',key_name='tempest-TestMinimumBasicScenario-2078449806',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3c8eef30d43d98388840e389efc24',ramdisk_id='',reservation_id='r-26nhe67r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2011934660',owner_user_name='tempest-TestMinimumBasicScenario-2011934660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:11:26Z,user_data=None,user_id='3992e0609efb4ad389253810ab9b0d33',uuid=bc351c09-798d-4048-b80f-0dbf85344edb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converting VIF {"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG os_vif [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc315ab1b-2e, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc315ab1b-2e, col_values=(('external_ids', {'iface-id': 'c315ab1b-2e05-4e8b-a995-849f3cb9249b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:f3:fa', 'vm-uuid': 'bc351c09-798d-4048-b80f-0dbf85344edb'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:29 user nova-compute[73121]: INFO os_vif [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e')
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No VIF found with MAC fa:16:3e:cb:f3:fa, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26661333737356335', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661333737356335', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.neutron [req-16dc732b-0b5b-4f94-accd-c38117c69b97 req-7cfe364a-7fc2-471e-8963-cd950bc41ef8 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updated VIF entry in instance network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.neutron [req-16dc732b-0b5b-4f94-accd-c38117c69b97 req-7cfe364a-7fc2-471e-8963-cd950bc41ef8 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updating instance_info_cache with network_info: [{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-16dc732b-0b5b-4f94-accd-c38117c69b97 req-7cfe364a-7fc2-471e-8963-cd950bc41ef8 service nova] Releasing lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2018312012',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2018312012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2018312012',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu/Blf1ddUEbks9bFxw4NGiWdDO9HPgJuQqYFarETOfQleO0IMFyhlOTjO73jNrcuK/zZK37PWVq2aMOi2BUDTDtxraI/ivXZs1TarLJ8DvRVF86YqMBu5b/imirGzLPQ==',key_name='tempest-keypair-472124211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-73cni1of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:11:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=00d2c851-39b9-40cb-8bac-785c954800cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:13:35,bridge_name='br-int',has_traffic_filtering=True,id=6cbc95d3-e345-4927-9abb-8e38f739af02,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc95d3-e3') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'pci_devices' on Instance uuid 00d2c851-39b9-40cb-8bac-785c954800cf {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:11:29 user nova-compute[73121]:   <uuid>00d2c851-39b9-40cb-8bac-785c954800cf</uuid>
Aug 15 02:11:29 user nova-compute[73121]:   <name>instance-0000001c</name>
Aug 15 02:11:29 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:11:29 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:11:29 user nova-compute[73121]:   <metadata>
Aug 15 02:11:29 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:11:29 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2018312012</nova:name>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:11:28</nova:creationTime>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:11:29 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:11:29 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:owner>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:user uuid="9f9c4f2ffebb440cb88132a502d51811">tempest-TestVolumeBootPattern-151395753-project-member</nova:user>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:project uuid="2e3397dd14ca44c19dc4386aec30a9a4">tempest-TestVolumeBootPattern-151395753</nova:project>
Aug 15 02:11:29 user nova-compute[73121]:       </nova:owner>
Aug 15 02:11:29 user nova-compute[73121]:       <nova:ports>
Aug 15 02:11:29 user nova-compute[73121]:         <nova:port uuid="6cbc95d3-e345-4927-9abb-8e38f739af02">
Aug 15 02:11:29 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 02:11:29 user nova-compute[73121]:         </nova:port>
Aug 15 02:11:29 user nova-compute[73121]:       </nova:ports>
Aug 15 02:11:29 user nova-compute[73121]:     </nova:instance>
Aug 15 02:11:29 user nova-compute[73121]:   </metadata>
Aug 15 02:11:29 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:11:29 user nova-compute[73121]:     <system>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="serial">00d2c851-39b9-40cb-8bac-785c954800cf</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="uuid">00d2c851-39b9-40cb-8bac-785c954800cf</entry>
Aug 15 02:11:29 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:11:29 user nova-compute[73121]:     </system>
Aug 15 02:11:29 user nova-compute[73121]:   </sysinfo>
Aug 15 02:11:29 user nova-compute[73121]:   <os>
Aug 15 02:11:29 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:11:29 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:11:29 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:11:29 user nova-compute[73121]:   </os>
Aug 15 02:11:29 user nova-compute[73121]:   <features>
Aug 15 02:11:29 user nova-compute[73121]:     <acpi/>
Aug 15 02:11:29 user nova-compute[73121]:     <apic/>
Aug 15 02:11:29 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:11:29 user nova-compute[73121]:   </features>
Aug 15 02:11:29 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:11:29 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:11:29 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:11:29 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:11:29 user nova-compute[73121]:   </clock>
Aug 15 02:11:29 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:11:29 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:11:29 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:11:29 user nova-compute[73121]:   </cpu>
Aug 15 02:11:29 user nova-compute[73121]:   <devices>
Aug 15 02:11:29 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:11:29 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:11:29 user nova-compute[73121]:       <source dev="/dev/sdc"/>
Aug 15 02:11:29 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:11:29 user nova-compute[73121]:       <serial>71530332-680c-4ff4-989e-f81f0f1b9757</serial>
Aug 15 02:11:29 user nova-compute[73121]:     </disk>
Aug 15 02:11:29 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:11:29 user nova-compute[73121]:       <mac address="fa:16:3e:a9:13:35"/>
Aug 15 02:11:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:11:29 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:11:29 user nova-compute[73121]:       <target dev="tap6cbc95d3-e3"/>
Aug 15 02:11:29 user nova-compute[73121]:     </interface>
Aug 15 02:11:29 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:11:29 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/00d2c851-39b9-40cb-8bac-785c954800cf/console.log" append="off"/>
Aug 15 02:11:29 user nova-compute[73121]:     </serial>
Aug 15 02:11:29 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:11:29 user nova-compute[73121]:     <video>
Aug 15 02:11:29 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:11:29 user nova-compute[73121]:     </video>
Aug 15 02:11:29 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:11:29 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:11:29 user nova-compute[73121]:     </rng>
Aug 15 02:11:29 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:11:29 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:11:29 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:11:29 user nova-compute[73121]:     </memballoon>
Aug 15 02:11:29 user nova-compute[73121]:   </devices>
Aug 15 02:11:29 user nova-compute[73121]: </domain>
Aug 15 02:11:29 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2018312012',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2018312012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2018312012',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu/Blf1ddUEbks9bFxw4NGiWdDO9HPgJuQqYFarETOfQleO0IMFyhlOTjO73jNrcuK/zZK37PWVq2aMOi2BUDTDtxraI/ivXZs1TarLJ8DvRVF86YqMBu5b/imirGzLPQ==',key_name='tempest-keypair-472124211',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-73cni1of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:11:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=00d2c851-39b9-40cb-8bac-785c954800cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:13:35,bridge_name='br-int',has_traffic_filtering=True,id=6cbc95d3-e345-4927-9abb-8e38f739af02,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc95d3-e3') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG os_vif [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:13:35,bridge_name='br-int',has_traffic_filtering=True,id=6cbc95d3-e345-4927-9abb-8e38f739af02,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc95d3-e3') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cbc95d3-e3, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6cbc95d3-e3, col_values=(('external_ids', {'iface-id': '6cbc95d3-e345-4927-9abb-8e38f739af02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:13:35', 'vm-uuid': '00d2c851-39b9-40cb-8bac-785c954800cf'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:29 user nova-compute[73121]: INFO os_vif [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:13:35,bridge_name='br-int',has_traffic_filtering=True,id=6cbc95d3-e345-4927-9abb-8e38f739af02,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc95d3-e3')
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No VIF found with MAC fa:16:3e:a9:13:35, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-705937a7-7147-49f0-ac7a-7262f9739105 req-565c2668-8dc6-4d3d-8558-480f792a97e6 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-705937a7-7147-49f0-ac7a-7262f9739105 req-565c2668-8dc6-4d3d-8558-480f792a97e6 service nova] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-705937a7-7147-49f0-ac7a-7262f9739105 req-565c2668-8dc6-4d3d-8558-480f792a97e6 service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-705937a7-7147-49f0-ac7a-7262f9739105 req-565c2668-8dc6-4d3d-8558-480f792a97e6 service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-705937a7-7147-49f0-ac7a-7262f9739105 req-565c2668-8dc6-4d3d-8558-480f792a97e6 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] No waiting events found dispatching network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:29 user nova-compute[73121]: WARNING nova.compute.manager [req-705937a7-7147-49f0-ac7a-7262f9739105 req-565c2668-8dc6-4d3d-8558-480f792a97e6 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received unexpected event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b for instance with vm_state active and task_state rebuilding.
Aug 15 02:11:30 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:11:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:11:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-8f003109-f2c3-4f69-99ed-f014de770c02 req-7d0a604e-0bf7-4a8f-9b6c-025540385f94 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8f003109-f2c3-4f69-99ed-f014de770c02 req-7d0a604e-0bf7-4a8f-9b6c-025540385f94 service nova] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8f003109-f2c3-4f69-99ed-f014de770c02 req-7d0a604e-0bf7-4a8f-9b6c-025540385f94 service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.016s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8f003109-f2c3-4f69-99ed-f014de770c02 req-7d0a604e-0bf7-4a8f-9b6c-025540385f94 service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-8f003109-f2c3-4f69-99ed-f014de770c02 req-7d0a604e-0bf7-4a8f-9b6c-025540385f94 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] No waiting events found dispatching network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:31 user nova-compute[73121]: WARNING nova.compute.manager [req-8f003109-f2c3-4f69-99ed-f014de770c02 req-7d0a604e-0bf7-4a8f-9b6c-025540385f94 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received unexpected event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b for instance with vm_state building and task_state spawning.
Aug 15 02:11:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] No waiting events found dispatching network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:33 user nova-compute[73121]: WARNING nova.compute.manager [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received unexpected event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b for instance with vm_state building and task_state spawning.
Aug 15 02:11:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received event network-vif-plugged-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] Acquiring lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] No waiting events found dispatching network-vif-plugged-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:33 user nova-compute[73121]: WARNING nova.compute.manager [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received unexpected event network-vif-plugged-6cbc95d3-e345-4927-9abb-8e38f739af02 for instance with vm_state building and task_state spawning.
Aug 15 02:11:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received event network-vif-plugged-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] Acquiring lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] No waiting events found dispatching network-vif-plugged-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:33 user nova-compute[73121]: WARNING nova.compute.manager [req-8738da82-8b72-4ba6-864d-1b119bae31f8 req-0401efc1-f429-45dd-ad72-6ae515e367a7 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received unexpected event network-vif-plugged-6cbc95d3-e345-4927-9abb-8e38f739af02 for instance with vm_state building and task_state spawning.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065494.5494204, bc351c09-798d-4048-b80f-0dbf85344edb => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] VM Resumed (Lifecycle Event)
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Instance spawned successfully.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Instance spawned successfully.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065494.5507305, bc351c09-798d-4048-b80f-0dbf85344edb => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] VM Started (Lifecycle Event)
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065494.5544457, 00d2c851-39b9-40cb-8bac-785c954800cf => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] VM Resumed (Lifecycle Event)
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Took 6.69 seconds to spawn the instance on the hypervisor.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Took 8.56 seconds to spawn the instance on the hypervisor.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065494.5565603, 00d2c851-39b9-40cb-8bac-785c954800cf => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] VM Started (Lifecycle Event)
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Took 9.71 seconds to build instance.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:11:34 user nova-compute[73121]: INFO nova.compute.manager [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Took 17.82 seconds to build instance.
Aug 15 02:11:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a6206ee2-4b9b-4ab3-82fb-591a8953b646 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.864s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e313d3c1-46de-41dd-b29e-1e46ac78f2c4 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "00d2c851-39b9-40cb-8bac-785c954800cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.920s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:35 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Instance destroyed successfully.
Aug 15 02:11:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-855829615',display_name='tempest-ServerActionsTestOtherA-server-692697073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-855829615',id=25,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcIcrbhJjrYWhm7yxLzom3j8e7JktsAHxdqN24zjZeszcJu/7p3089G9bv7YEcqWJNb7rGjE2FAn8nBvFRG6CPZwnjnAtpFtfW5CD7QywBzacqZTRd6YdGBKys72Rxgfw==',key_name='tempest-keypair-1324962593',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:09:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-10b7bgr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:11:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=be6f8247-2be1-4add-92e9-54e4bef5c44c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_vif [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cff72bc-b5, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:11:35 user nova-compute[73121]: INFO os_vif [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5')
Aug 15 02:11:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHTMVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:11:35 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfa3615-4dac-4400-90c6-a895444aed18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1b3896-150c-4c05-b944-a588840f7306]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:35 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:11:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:35 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:11:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e205d77f0>, {}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Disconnecting from: [] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.052s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== disconnect_volume: return (54ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:11:35 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Deleting instance files /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c_del
Aug 15 02:11:35 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Deletion of /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c_del complete
Aug 15 02:11:35 user nova-compute[73121]: INFO nova.virt.block_device [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Booting with volume bd74c2bc-2cc4-44dd-8da3-e578c6de9791 at /dev/vdb
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.utils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[81415419-c5f9-4670-9ef9-fc8c38287e6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a85c3e-1301-4101-a996-a262caf1625e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8fe661-f4c6-4c4c-b22d-6ded188ef484]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db12eb4-829e-46db-b98d-0a7c13d962eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:11:35 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:11:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b6ed86-3b0a-4248-8896-d655bdf7897f]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG os_brick.utils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:11:35 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Updating existing volume attachment record: 19ee6063-654b-4199-a9b3-8c55168c7912 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:11:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:40 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065485.155994, be6f8247-2be1-4add-92e9-54e4bef5c44c => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:40 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] VM Stopped (Lifecycle Event)
Aug 15 02:11:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-06a57285-d03f-4e6f-ba84-ed809b099069 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-d80ff2eb-8264-4058-8122-82ce1493120b req-0ca1978e-cce9-4e59-bf8b-d5474f1545e2 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received event network-changed-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-d80ff2eb-8264-4058-8122-82ce1493120b req-0ca1978e-cce9-4e59-bf8b-d5474f1545e2 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Refreshing instance network info cache due to event network-changed-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:11:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d80ff2eb-8264-4058-8122-82ce1493120b req-0ca1978e-cce9-4e59-bf8b-d5474f1545e2 service nova] Acquiring lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:11:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d80ff2eb-8264-4058-8122-82ce1493120b req-0ca1978e-cce9-4e59-bf8b-d5474f1545e2 service nova] Acquired lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:11:40 user nova-compute[73121]: DEBUG nova.network.neutron [req-d80ff2eb-8264-4058-8122-82ce1493120b req-0ca1978e-cce9-4e59-bf8b-d5474f1545e2 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Refreshing network info cache for port abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:11:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:41 user nova-compute[73121]: DEBUG nova.network.neutron [req-d80ff2eb-8264-4058-8122-82ce1493120b req-0ca1978e-cce9-4e59-bf8b-d5474f1545e2 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updated VIF entry in instance network info cache for port abf3d1bd-5c66-4e3a-8aa3-2323ced964fb. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:11:41 user nova-compute[73121]: DEBUG nova.network.neutron [req-d80ff2eb-8264-4058-8122-82ce1493120b req-0ca1978e-cce9-4e59-bf8b-d5474f1545e2 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updating instance_info_cache with network_info: [{"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d80ff2eb-8264-4058-8122-82ce1493120b req-0ca1978e-cce9-4e59-bf8b-d5474f1545e2 service nova] Releasing lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:11:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:45 user nova-compute[73121]: INFO nova.compute.manager [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attaching volume 30fa2955-3b39-464a-8e34-0e160101b86c to /dev/vdb
Aug 15 02:11:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG os_brick.utils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca9690f-4592-4b0e-9302-31fd64d7cb2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec6ff0b-62d4-416c-81c9-e2ba96efadda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf4d462-31e5-493b-b45f-14973ff573b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2163d72-b07d-4f61-9598-579f9ac6c0c2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:11:45 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Creating image(s)
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:11:45 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4765338-0b87-47f1-ac43-03227cdf9158]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG os_brick.utils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updating existing volume attachment record: a1e13216-b53e-4ad2-a808-b7fbee6ef8fe {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk 1073741824" returned: 0 in 0.067s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Cannot resize image /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Ensure instance console log exists: /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Start _get_guest_xml network_info=[{"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '19ee6063-654b-4199-a9b3-8c55168c7912', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHTMVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'be6f8247-2be1-4add-92e9-54e4bef5c44c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bd74c2bc-2cc4-44dd-8da3-e578c6de9791', 'serial': 'bd74c2bc-2cc4-44dd-8da3-e578c6de9791'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:11:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 02:11:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'vcpu_model' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHTMVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:11:46 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:11:46 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:11:46 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da9006c-f4a5-439f-b4e3-c6c55ca7824c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:11:46 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd622ff-f2fc-46c0-9cba-5d486744294d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791] added
Aug 15 02:11:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbf8a61-27d9-4fa0-a634-81bc6091619e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e6500a-339b-44f9-8679-0d18c1f0f3af]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWFHTMVs {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zWFHTMVs" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff883d9-18c4-4e38-a5b5-b67ba1848f55]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zWFHTMVs'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[01307e4a-d165-423a-8511-642869f58198]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36b457f-970b-41d5-aae4-286e50ebdf3a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85935d5-1c86-4693-819d-2fadbf4e5ddd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260]
Aug 15 02:11:46 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260] successful.
Aug 15 02:11:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a079f54-8e10-42eb-9b45-0cab6e90fe43]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de2be16-7151-4e53-b743-712f00bd4dca]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:11:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:11:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:11:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:11:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d75223-ebe2-40b5-86a7-42cfdd1d9b88]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:11:47 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:11:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHTMVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:11:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26633646161623666', 'path': '/dev/sdd'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26633646161623666', 'path': '/dev/sdd'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-855829615',display_name='tempest-ServerActionsTestOtherA-server-692697073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-855829615',id=25,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcIcrbhJjrYWhm7yxLzom3j8e7JktsAHxdqN24zjZeszcJu/7p3089G9bv7YEcqWJNb7rGjE2FAn8nBvFRG6CPZwnjnAtpFtfW5CD7QywBzacqZTRd6YdGBKys72Rxgfw==',key_name='tempest-keypair-1324962593',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:09:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-10b7bgr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=be6f8247-2be1-4add-92e9-54e4bef5c44c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:11:48 user nova-compute[73121]:   <uuid>be6f8247-2be1-4add-92e9-54e4bef5c44c</uuid>
Aug 15 02:11:48 user nova-compute[73121]:   <name>instance-00000019</name>
Aug 15 02:11:48 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:11:48 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:11:48 user nova-compute[73121]:   <metadata>
Aug 15 02:11:48 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:11:48 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:11:48 user nova-compute[73121]:       <nova:name>tempest-ServerActionsTestOtherA-server-692697073</nova:name>
Aug 15 02:11:48 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:11:46</nova:creationTime>
Aug 15 02:11:48 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:11:48 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:11:48 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:11:48 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:11:48 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:11:48 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:11:48 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:11:48 user nova-compute[73121]:       <nova:owner>
Aug 15 02:11:48 user nova-compute[73121]:         <nova:user uuid="f22753e4f3934dddab87961c43c68fb2">tempest-ServerActionsTestOtherA-148244694-project-member</nova:user>
Aug 15 02:11:48 user nova-compute[73121]:         <nova:project uuid="fb0739b6fd0a4c3097a1e0d329176a78">tempest-ServerActionsTestOtherA-148244694</nova:project>
Aug 15 02:11:48 user nova-compute[73121]:       </nova:owner>
Aug 15 02:11:48 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:11:48 user nova-compute[73121]:       <nova:ports>
Aug 15 02:11:48 user nova-compute[73121]:         <nova:port uuid="5cff72bc-b5f5-4ac2-a334-0672a871e44b">
Aug 15 02:11:48 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 02:11:48 user nova-compute[73121]:         </nova:port>
Aug 15 02:11:48 user nova-compute[73121]:       </nova:ports>
Aug 15 02:11:48 user nova-compute[73121]:     </nova:instance>
Aug 15 02:11:48 user nova-compute[73121]:   </metadata>
Aug 15 02:11:48 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:11:48 user nova-compute[73121]:     <system>
Aug 15 02:11:48 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:11:48 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:11:48 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:11:48 user nova-compute[73121]:       <entry name="serial">be6f8247-2be1-4add-92e9-54e4bef5c44c</entry>
Aug 15 02:11:48 user nova-compute[73121]:       <entry name="uuid">be6f8247-2be1-4add-92e9-54e4bef5c44c</entry>
Aug 15 02:11:48 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:11:48 user nova-compute[73121]:     </system>
Aug 15 02:11:48 user nova-compute[73121]:   </sysinfo>
Aug 15 02:11:48 user nova-compute[73121]:   <os>
Aug 15 02:11:48 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:11:48 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:11:48 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:11:48 user nova-compute[73121]:   </os>
Aug 15 02:11:48 user nova-compute[73121]:   <features>
Aug 15 02:11:48 user nova-compute[73121]:     <acpi/>
Aug 15 02:11:48 user nova-compute[73121]:     <apic/>
Aug 15 02:11:48 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:11:48 user nova-compute[73121]:   </features>
Aug 15 02:11:48 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:11:48 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:11:48 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:11:48 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:11:48 user nova-compute[73121]:   </clock>
Aug 15 02:11:48 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:11:48 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:11:48 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:11:48 user nova-compute[73121]:   </cpu>
Aug 15 02:11:48 user nova-compute[73121]:   <devices>
Aug 15 02:11:48 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:11:48 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:11:48 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk"/>
Aug 15 02:11:48 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:11:48 user nova-compute[73121]:     </disk>
Aug 15 02:11:48 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:11:48 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:11:48 user nova-compute[73121]:       <source dev="/dev/sdd"/>
Aug 15 02:11:48 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:11:48 user nova-compute[73121]:       <serial>bd74c2bc-2cc4-44dd-8da3-e578c6de9791</serial>
Aug 15 02:11:48 user nova-compute[73121]:     </disk>
Aug 15 02:11:48 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:11:48 user nova-compute[73121]:       <mac address="fa:16:3e:28:50:2c"/>
Aug 15 02:11:48 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:11:48 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:11:48 user nova-compute[73121]:       <target dev="tap5cff72bc-b5"/>
Aug 15 02:11:48 user nova-compute[73121]:     </interface>
Aug 15 02:11:48 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:11:48 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/console.log" append="off"/>
Aug 15 02:11:48 user nova-compute[73121]:     </serial>
Aug 15 02:11:48 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:11:48 user nova-compute[73121]:     <video>
Aug 15 02:11:48 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:11:48 user nova-compute[73121]:     </video>
Aug 15 02:11:48 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:11:48 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:11:48 user nova-compute[73121]:     </rng>
Aug 15 02:11:48 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:11:48 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:11:48 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:11:48 user nova-compute[73121]:     </memballoon>
Aug 15 02:11:48 user nova-compute[73121]:   </devices>
Aug 15 02:11:48 user nova-compute[73121]: </domain>
Aug 15 02:11:48 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-855829615',display_name='tempest-ServerActionsTestOtherA-server-692697073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-855829615',id=25,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcIcrbhJjrYWhm7yxLzom3j8e7JktsAHxdqN24zjZeszcJu/7p3089G9bv7YEcqWJNb7rGjE2FAn8nBvFRG6CPZwnjnAtpFtfW5CD7QywBzacqZTRd6YdGBKys72Rxgfw==',key_name='tempest-keypair-1324962593',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:09:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-10b7bgr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=be6f8247-2be1-4add-92e9-54e4bef5c44c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG os_vif [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cff72bc-b5, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5cff72bc-b5, col_values=(('external_ids', {'iface-id': '5cff72bc-b5f5-4ac2-a334-0672a871e44b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:50:2c', 'vm-uuid': 'be6f8247-2be1-4add-92e9-54e4bef5c44c'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:48 user nova-compute[73121]: INFO os_vif [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5')
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:11:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No VIF found with MAC fa:16:3e:28:50:2c, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-d7ce02ea-126f-4638-9c36-ac1a97dcb9d0 req-0e5eb1ba-737d-47d3-8d55-3725d398968b service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d7ce02ea-126f-4638-9c36-ac1a97dcb9d0 req-0e5eb1ba-737d-47d3-8d55-3725d398968b service nova] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d7ce02ea-126f-4638-9c36-ac1a97dcb9d0 req-0e5eb1ba-737d-47d3-8d55-3725d398968b service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d7ce02ea-126f-4638-9c36-ac1a97dcb9d0 req-0e5eb1ba-737d-47d3-8d55-3725d398968b service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-d7ce02ea-126f-4638-9c36-ac1a97dcb9d0 req-0e5eb1ba-737d-47d3-8d55-3725d398968b service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] No waiting events found dispatching network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:49 user nova-compute[73121]: WARNING nova.compute.manager [req-d7ce02ea-126f-4638-9c36-ac1a97dcb9d0 req-0e5eb1ba-737d-47d3-8d55-3725d398968b service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received unexpected event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b for instance with vm_state active and task_state rebuild_spawning.
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065511.8737652, be6f8247-2be1-4add-92e9-54e4bef5c44c => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:51 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] VM Resumed (Lifecycle Event)
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:11:51 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Instance spawned successfully.
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:11:51 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065511.8752253, be6f8247-2be1-4add-92e9-54e4bef5c44c => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:11:51 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] VM Started (Lifecycle Event)
Aug 15 02:11:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-6fe7f592-dad7-483c-a5df-a145ec6b40da req-288733d7-3846-4289-a4b2-bf79a5e29e09 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6fe7f592-dad7-483c-a5df-a145ec6b40da req-288733d7-3846-4289-a4b2-bf79a5e29e09 service nova] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6fe7f592-dad7-483c-a5df-a145ec6b40da req-288733d7-3846-4289-a4b2-bf79a5e29e09 service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6fe7f592-dad7-483c-a5df-a145ec6b40da req-288733d7-3846-4289-a4b2-bf79a5e29e09 service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-6fe7f592-dad7-483c-a5df-a145ec6b40da req-288733d7-3846-4289-a4b2-bf79a5e29e09 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] No waiting events found dispatching network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:11:52 user nova-compute[73121]: WARNING nova.compute.manager [req-6fe7f592-dad7-483c-a5df-a145ec6b40da req-288733d7-3846-4289-a4b2-bf79a5e29e09 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received unexpected event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b for instance with vm_state active and task_state rebuild_spawning.
Aug 15 02:11:52 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:11:52 user nova-compute[73121]: INFO nova.compute.claims [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Claim successful on node user
Aug 15 02:11:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.539s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.466s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73121) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.network.neutron [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:11:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9e3500b9-4c4c-428f-b694-89fec9f4bb3e tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:11:52 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:11:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:11:52 user nova-compute[73121]: INFO nova.virt.block_device [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Booting with volume-backed-image a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb at /dev/vda
Aug 15 02:11:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:53 user nova-compute[73121]: DEBUG nova.policy [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4d8ef0b0581e4a10b066c15119bafde1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea879c6a9d1f4d58998e077524a07225', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:11:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Successfully created port: c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:11:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Successfully updated port: c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-d908751c-ac13-4ffb-85c9-7dcc4488e6ef req-fd814489-aa21-4d25-a251-003245af3036 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-changed-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-d908751c-ac13-4ffb-85c9-7dcc4488e6ef req-fd814489-aa21-4d25-a251-003245af3036 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Refreshing instance network info cache due to event network-changed-c423ec03-ba94-4691-bcc1-b7354e3b1a80. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d908751c-ac13-4ffb-85c9-7dcc4488e6ef req-fd814489-aa21-4d25-a251-003245af3036 service nova] Acquiring lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d908751c-ac13-4ffb-85c9-7dcc4488e6ef req-fd814489-aa21-4d25-a251-003245af3036 service nova] Acquired lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-d908751c-ac13-4ffb-85c9-7dcc4488e6ef req-fd814489-aa21-4d25-a251-003245af3036 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Refreshing network info cache for port c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-d908751c-ac13-4ffb-85c9-7dcc4488e6ef req-fd814489-aa21-4d25-a251-003245af3036 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-d908751c-ac13-4ffb-85c9-7dcc4488e6ef req-fd814489-aa21-4d25-a251-003245af3036 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d908751c-ac13-4ffb-85c9-7dcc4488e6ef req-fd814489-aa21-4d25-a251-003245af3036 service nova] Releasing lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquired lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Updating instance_info_cache with network_info: [{"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Releasing lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:11:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance network_info: |[{"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:11:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:11:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:11:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:11:59 user nova-compute[73121]: DEBUG nova.objects.instance [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'flavor' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:11:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:00 user nova-compute[73121]: INFO nova.compute.manager [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Attaching volume c3549704-2d58-4476-88a0-72b25fd7ddc7 to /dev/vdb
Aug 15 02:12:00 user nova-compute[73121]: DEBUG os_brick.utils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a540c4-4b19-4485-bbc0-b9fbdc9ec569]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16c0ed4-443e-437f-ba8e-4f03a8f68ec8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff133f1-2145-4621-833f-a24ee89310c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9b087d-814c-4d14-81f9-27eb52d8ee74]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:12:00 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f170c6-1fea-4f6e-a932-1d5b864617a7]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG os_brick.utils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating existing volume attachment record: ee146d75-d9f6-4924-8627-1f141b2bccc7 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:00 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:12:00 user nova-compute[73121]: INFO nova.compute.claims [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Claim successful on node user
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfBwHEKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:12:01 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:01 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:01 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b522d51c-b782-4caf-bd21-e700fc612d54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:12:01 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5069682e-db42-4020-acea-660513be1b44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c] added
Aug 15 02:12:01 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[43530d5f-ff77-49aa-a90e-2c7fbbd5e5d1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e709a-6f4f-42c5-a6ca-9698a10b134a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:01 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfBwHEKQ {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DfBwHEKQ" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16de70c-88f5-417d-8bdb-0984b3010896]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DfBwHEKQ'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc54f21-5fa4-40d1-8073-0cf38ac11a5d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e896ba-13c9-4535-b320-5b8a353b4d45]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:12:01 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Creating image(s)
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "/opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "/opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "/opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG nova.policy [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c1e20e779ac4711803956ee2a2accaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc744b107dc4a8baa3274788b094e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[899fb3e8-9e58-4cb6-8a3d-857248abd5a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c, portal: 172.16.0.220,3260]
Aug 15 02:12:01 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c, portal: 172.16.0.220,3260] successful.
Aug 15 02:12:01 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc57293-0e28-4ec1-ab7e-56c07dfe5cfe]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[419cf6f3-fc6e-4c41-8c11-fb4371f96474]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:01 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:01 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:01 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.400s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe9b5e0-00ec-462e-a747-003caa1c4956]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.220s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.235s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk 1073741824" returned: 0 in 0.067s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.223s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Successfully created port: 51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Cannot resize image /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'migration_context' on Instance uuid 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Ensure instance console log exists: /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfBwHEKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '26562343637623135', 'path': '/dev/sde'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562343637623135', 'path': '/dev/sde'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:12:02 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:12:02 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:12:02 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:12:02 user nova-compute[73121]:   <serial>30fa2955-3b39-464a-8e34-0e160101b86c</serial>
Aug 15 02:12:02 user nova-compute[73121]: </disk>
Aug 15 02:12:02 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No VIF found with MAC fa:16:3e:1c:c1:76, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.network.neutron [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Successfully updated port: 51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "refresh_cache-421fb8ac-c579-469a-9dda-e6ea7e2f6b48" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquired lock "refresh_cache-421fb8ac-c579-469a-9dda-e6ea7e2f6b48" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.network.neutron [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-8f47f849-d3ee-4453-8962-83f9a11d03cb req-6979d667-d0b9-4886-a424-93e054f41eed service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received event network-changed-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-8f47f849-d3ee-4453-8962-83f9a11d03cb req-6979d667-d0b9-4886-a424-93e054f41eed service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Refreshing instance network info cache due to event network-changed-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8f47f849-d3ee-4453-8962-83f9a11d03cb req-6979d667-d0b9-4886-a424-93e054f41eed service nova] Acquiring lock "refresh_cache-421fb8ac-c579-469a-9dda-e6ea7e2f6b48" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a0efed71-d37a-4e6b-af47-0f2bcea3916c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.714s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.network.neutron [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.network.neutron [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Updating instance_info_cache with network_info: [{"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Releasing lock "refresh_cache-421fb8ac-c579-469a-9dda-e6ea7e2f6b48" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Instance network_info: |[{"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8f47f849-d3ee-4453-8962-83f9a11d03cb req-6979d667-d0b9-4886-a424-93e054f41eed service nova] Acquired lock "refresh_cache-421fb8ac-c579-469a-9dda-e6ea7e2f6b48" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.network.neutron [req-8f47f849-d3ee-4453-8962-83f9a11d03cb req-6979d667-d0b9-4886-a424-93e054f41eed service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Refreshing network info cache for port 51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Start _get_guest_xml network_info=[{"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:12:03 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:12:03 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-53239991',display_name='tempest-AttachVolumeNegativeTest-server-53239991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-53239991',id=31,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQeBdaqy7+JhiiZW+8vzKowe3j1ZZUPCVWovaOBbKhTNsJoCB31CTl63H3F3hDB1Qg6rddAxB5NvAQHUEjYA3N2SuUG5qBSDR3YYSD29iGSArk+b5hKKphmBTFZLAvliA==',key_name='tempest-keypair-1782204711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-l5vszd0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:12:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=421fb8ac-c579-469a-9dda-e6ea7e2f6b48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:5c,bridge_name='br-int',has_traffic_filtering=True,id=51b00c9c-5181-4b2d-ba59-24eb2a4eb11a,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b00c9c-51') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.objects.instance [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'pci_devices' on Instance uuid 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:12:03 user nova-compute[73121]:   <uuid>421fb8ac-c579-469a-9dda-e6ea7e2f6b48</uuid>
Aug 15 02:12:03 user nova-compute[73121]:   <name>instance-0000001f</name>
Aug 15 02:12:03 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:12:03 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:12:03 user nova-compute[73121]:   <metadata>
Aug 15 02:12:03 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:12:03 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:12:03 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeNegativeTest-server-53239991</nova:name>
Aug 15 02:12:03 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:12:03</nova:creationTime>
Aug 15 02:12:03 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:12:03 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:12:03 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:12:03 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:12:03 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:12:03 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:12:03 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:12:03 user nova-compute[73121]:       <nova:owner>
Aug 15 02:12:03 user nova-compute[73121]:         <nova:user uuid="5c1e20e779ac4711803956ee2a2accaa">tempest-AttachVolumeNegativeTest-2069847524-project-member</nova:user>
Aug 15 02:12:03 user nova-compute[73121]:         <nova:project uuid="fcc744b107dc4a8baa3274788b094e2d">tempest-AttachVolumeNegativeTest-2069847524</nova:project>
Aug 15 02:12:03 user nova-compute[73121]:       </nova:owner>
Aug 15 02:12:03 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:12:03 user nova-compute[73121]:       <nova:ports>
Aug 15 02:12:03 user nova-compute[73121]:         <nova:port uuid="51b00c9c-5181-4b2d-ba59-24eb2a4eb11a">
Aug 15 02:12:03 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 02:12:03 user nova-compute[73121]:         </nova:port>
Aug 15 02:12:03 user nova-compute[73121]:       </nova:ports>
Aug 15 02:12:03 user nova-compute[73121]:     </nova:instance>
Aug 15 02:12:03 user nova-compute[73121]:   </metadata>
Aug 15 02:12:03 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:12:03 user nova-compute[73121]:     <system>
Aug 15 02:12:03 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:12:03 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:12:03 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:12:03 user nova-compute[73121]:       <entry name="serial">421fb8ac-c579-469a-9dda-e6ea7e2f6b48</entry>
Aug 15 02:12:03 user nova-compute[73121]:       <entry name="uuid">421fb8ac-c579-469a-9dda-e6ea7e2f6b48</entry>
Aug 15 02:12:03 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:12:03 user nova-compute[73121]:     </system>
Aug 15 02:12:03 user nova-compute[73121]:   </sysinfo>
Aug 15 02:12:03 user nova-compute[73121]:   <os>
Aug 15 02:12:03 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:12:03 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:12:03 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:12:03 user nova-compute[73121]:   </os>
Aug 15 02:12:03 user nova-compute[73121]:   <features>
Aug 15 02:12:03 user nova-compute[73121]:     <acpi/>
Aug 15 02:12:03 user nova-compute[73121]:     <apic/>
Aug 15 02:12:03 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:12:03 user nova-compute[73121]:   </features>
Aug 15 02:12:03 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:12:03 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:12:03 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:12:03 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:12:03 user nova-compute[73121]:   </clock>
Aug 15 02:12:03 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:12:03 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:12:03 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:12:03 user nova-compute[73121]:   </cpu>
Aug 15 02:12:03 user nova-compute[73121]:   <devices>
Aug 15 02:12:03 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:12:03 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:12:03 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk"/>
Aug 15 02:12:03 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:12:03 user nova-compute[73121]:     </disk>
Aug 15 02:12:03 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:12:03 user nova-compute[73121]:       <mac address="fa:16:3e:e1:97:5c"/>
Aug 15 02:12:03 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:12:03 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:12:03 user nova-compute[73121]:       <target dev="tap51b00c9c-51"/>
Aug 15 02:12:03 user nova-compute[73121]:     </interface>
Aug 15 02:12:03 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:12:03 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/console.log" append="off"/>
Aug 15 02:12:03 user nova-compute[73121]:     </serial>
Aug 15 02:12:03 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:12:03 user nova-compute[73121]:     <video>
Aug 15 02:12:03 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:12:03 user nova-compute[73121]:     </video>
Aug 15 02:12:03 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:12:03 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:12:03 user nova-compute[73121]:     </rng>
Aug 15 02:12:03 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:12:03 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:12:03 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:12:03 user nova-compute[73121]:     </memballoon>
Aug 15 02:12:03 user nova-compute[73121]:   </devices>
Aug 15 02:12:03 user nova-compute[73121]: </domain>
Aug 15 02:12:03 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-53239991',display_name='tempest-AttachVolumeNegativeTest-server-53239991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-53239991',id=31,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQeBdaqy7+JhiiZW+8vzKowe3j1ZZUPCVWovaOBbKhTNsJoCB31CTl63H3F3hDB1Qg6rddAxB5NvAQHUEjYA3N2SuUG5qBSDR3YYSD29iGSArk+b5hKKphmBTFZLAvliA==',key_name='tempest-keypair-1782204711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-l5vszd0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:12:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=421fb8ac-c579-469a-9dda-e6ea7e2f6b48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:5c,bridge_name='br-int',has_traffic_filtering=True,id=51b00c9c-5181-4b2d-ba59-24eb2a4eb11a,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b00c9c-51') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG os_vif [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:5c,bridge_name='br-int',has_traffic_filtering=True,id=51b00c9c-5181-4b2d-ba59-24eb2a4eb11a,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b00c9c-51') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51b00c9c-51, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51b00c9c-51, col_values=(('external_ids', {'iface-id': '51b00c9c-5181-4b2d-ba59-24eb2a4eb11a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:97:5c', 'vm-uuid': '421fb8ac-c579-469a-9dda-e6ea7e2f6b48'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:03 user nova-compute[73121]: INFO os_vif [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:5c,bridge_name='br-int',has_traffic_filtering=True,id=51b00c9c-5181-4b2d-ba59-24eb2a4eb11a,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b00c9c-51')
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:12:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No VIF found with MAC fa:16:3e:e1:97:5c, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:12:04 user nova-compute[73121]: DEBUG nova.network.neutron [req-8f47f849-d3ee-4453-8962-83f9a11d03cb req-6979d667-d0b9-4886-a424-93e054f41eed service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Updated VIF entry in instance network info cache for port 51b00c9c-5181-4b2d-ba59-24eb2a4eb11a. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:12:04 user nova-compute[73121]: DEBUG nova.network.neutron [req-8f47f849-d3ee-4453-8962-83f9a11d03cb req-6979d667-d0b9-4886-a424-93e054f41eed service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Updating instance_info_cache with network_info: [{"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:12:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8f47f849-d3ee-4453-8962-83f9a11d03cb req-6979d667-d0b9-4886-a424-93e054f41eed service nova] Releasing lock "refresh_cache-421fb8ac-c579-469a-9dda-e6ea7e2f6b48" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:12:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-c5cd5956-7724-482b-b06a-765cc7774950 req-8b1b9443-daad-4a0a-84b4-3c7f6f8cd32c service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received event network-vif-plugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c5cd5956-7724-482b-b06a-765cc7774950 req-8b1b9443-daad-4a0a-84b4-3c7f6f8cd32c service nova] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c5cd5956-7724-482b-b06a-765cc7774950 req-8b1b9443-daad-4a0a-84b4-3c7f6f8cd32c service nova] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c5cd5956-7724-482b-b06a-765cc7774950 req-8b1b9443-daad-4a0a-84b4-3c7f6f8cd32c service nova] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-c5cd5956-7724-482b-b06a-765cc7774950 req-8b1b9443-daad-4a0a-84b4-3c7f6f8cd32c service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] No waiting events found dispatching network-vif-plugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:12:05 user nova-compute[73121]: WARNING nova.compute.manager [req-c5cd5956-7724-482b-b06a-765cc7774950 req-8b1b9443-daad-4a0a-84b4-3c7f6f8cd32c service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received unexpected event network-vif-plugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a for instance with vm_state building and task_state spawning.
Aug 15 02:12:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-96c253db-cebf-4bbc-ad9b-f7ecfd842a8c req-dc3669a8-c309-4a9a-946e-a8f8a1984ba2 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received event network-vif-plugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96c253db-cebf-4bbc-ad9b-f7ecfd842a8c req-dc3669a8-c309-4a9a-946e-a8f8a1984ba2 service nova] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96c253db-cebf-4bbc-ad9b-f7ecfd842a8c req-dc3669a8-c309-4a9a-946e-a8f8a1984ba2 service nova] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96c253db-cebf-4bbc-ad9b-f7ecfd842a8c req-dc3669a8-c309-4a9a-946e-a8f8a1984ba2 service nova] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-96c253db-cebf-4bbc-ad9b-f7ecfd842a8c req-dc3669a8-c309-4a9a-946e-a8f8a1984ba2 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] No waiting events found dispatching network-vif-plugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:12:07 user nova-compute[73121]: WARNING nova.compute.manager [req-96c253db-cebf-4bbc-ad9b-f7ecfd842a8c req-dc3669a8-c309-4a9a-946e-a8f8a1984ba2 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received unexpected event network-vif-plugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a for instance with vm_state building and task_state spawning.
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065527.8778496, 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:12:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] VM Resumed (Lifecycle Event)
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:12:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Instance spawned successfully.
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065527.8810546, 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:12:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] VM Started (Lifecycle Event)
Aug 15 02:12:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:12:08 user nova-compute[73121]: INFO nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Took 6.69 seconds to spawn the instance on the hypervisor.
Aug 15 02:12:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:12:08 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:12:08 user nova-compute[73121]: INFO nova.compute.manager [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Took 7.61 seconds to build instance.
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-8a6fcb6e-1de8-4651-98e6-11d3baf04f4d tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.707s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG os_brick.utils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d8dc9d-3a88-48c4-92bc-c47fe6bacdb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[610f27af-efc1-4db8-8e4e-fb5ac8873c5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc50c981-9481-492a-b144-c441be11d15d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adbe21f-310f-4a54-bf94-37bddd7c0630]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:12:08 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:12:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[678484ca-eb67-4f05-96a9-09959de06608]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG os_brick.utils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:12:08 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Updating existing volume attachment record: 745f1f67-478f-45f6-98e1-17a75ff0f962 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaoBLYvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:12:11 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:11 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:11 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dd4632-e909-4d51-b02d-ef493416d60a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:12:11 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[816d08d3-214e-4fab-b136-e48a76efd1b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7] added
Aug 15 02:12:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02f3415-a11e-404e-9693-6bce909b5324]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5df87b-2538-45e4-9487-0a6970e88939]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaoBLYvF {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaoBLYvF" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7449e1f9-45c6-4e12-b884-277c58dbb560]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaoBLYvF'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[914b5cd5-b640-4c4b-a6ee-e99e986279b7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b1f8f6-a9be-433d-b4a7-26cc6ffa3e2b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fb5b84-e6bc-49cc-afd9-8f0347ca7851]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7, portal: 172.16.0.220,3260]
Aug 15 02:12:11 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7, portal: 172.16.0.220,3260] successful.
Aug 15 02:12:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12b8d85-84c6-45c2-b5e5-379c45ee152f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d04d04-d863-4edc-96a2-f081231c2570]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:11 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc381e7-79a5-4830-821d-4c660ce3c238]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:12:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaoBLYvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:12:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '26161346530353562', 'path': '/dev/sdf'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:12:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161346530353562', 'path': '/dev/sdf'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:12:12 user nova-compute[73121]: DEBUG nova.objects.instance [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'flavor' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:12:12 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:12:12 user nova-compute[73121]:   <source dev="/dev/sdf"/>
Aug 15 02:12:12 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:12:12 user nova-compute[73121]:   <serial>c3549704-2d58-4476-88a0-72b25fd7ddc7</serial>
Aug 15 02:12:12 user nova-compute[73121]: </disk>
Aug 15 02:12:12 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:12:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:12:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:12:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] No VIF found with MAC fa:16:3e:6b:c7:ac, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:12:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-34b9009b-d159-4926-ab99-673cb177dcf9 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.154s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:14 user nova-compute[73121]: INFO nova.compute.manager [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Rescuing
Aug 15 02:12:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:12:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquired lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:12:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:12:15 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating instance_info_cache with network_info: [{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:12:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Releasing lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:12:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-2045f7cc-cc9a-4954-b544-c07f1fc8d44d req-3c53aca5-f91e-4714-800b-e371946f8f27 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-unplugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2045f7cc-cc9a-4954-b544-c07f1fc8d44d req-3c53aca5-f91e-4714-800b-e371946f8f27 service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2045f7cc-cc9a-4954-b544-c07f1fc8d44d req-3c53aca5-f91e-4714-800b-e371946f8f27 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2045f7cc-cc9a-4954-b544-c07f1fc8d44d req-3c53aca5-f91e-4714-800b-e371946f8f27 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-2045f7cc-cc9a-4954-b544-c07f1fc8d44d req-3c53aca5-f91e-4714-800b-e371946f8f27 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-unplugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:12:16 user nova-compute[73121]: WARNING nova.compute.manager [req-2045f7cc-cc9a-4954-b544-c07f1fc8d44d req-3c53aca5-f91e-4714-800b-e371946f8f27 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-unplugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state active and task_state rescuing.
Aug 15 02:12:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Instance destroyed successfully.
Aug 15 02:12:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Attempting a stable device rescue
Aug 15 02:12:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73121) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Instance directory exists: not creating {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 02:12:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Creating image(s)
Aug 15 02:12:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'trusted_certs' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "436def45bbecee2c9b221de4179377ebda4fa1b4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "436def45bbecee2c9b221de4179377ebda4fa1b4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4.part --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG nova.virt.images [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] 9544747d-a446-4401-9c84-2ad5a75ca6bb was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4.part /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-44a479ed-8db6-4c9e-a71f-dfd0e2ba9c3a req-7a6a9f13-0fb5-40d9-8b5f-427f3203ceed service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-44a479ed-8db6-4c9e-a71f-dfd0e2ba9c3a req-7a6a9f13-0fb5-40d9-8b5f-427f3203ceed service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-44a479ed-8db6-4c9e-a71f-dfd0e2ba9c3a req-7a6a9f13-0fb5-40d9-8b5f-427f3203ceed service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-44a479ed-8db6-4c9e-a71f-dfd0e2ba9c3a req-7a6a9f13-0fb5-40d9-8b5f-427f3203ceed service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-44a479ed-8db6-4c9e-a71f-dfd0e2ba9c3a req-7a6a9f13-0fb5-40d9-8b5f-427f3203ceed service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:12:18 user nova-compute[73121]: WARNING nova.compute.manager [req-44a479ed-8db6-4c9e-a71f-dfd0e2ba9c3a req-7a6a9f13-0fb5-40d9-8b5f-427f3203ceed service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state active and task_state rescuing.
Aug 15 02:12:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4.part /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4.converted" returned: 0 in 0.859s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4.converted --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "436def45bbecee2c9b221de4179377ebda4fa1b4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.424s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "436def45bbecee2c9b221de4179377ebda4fa1b4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "436def45bbecee2c9b221de4179377ebda4fa1b4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4 --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4,backing_fmt=raw /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4,backing_fmt=raw /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue" returned: 0 in 0.059s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "436def45bbecee2c9b221de4179377ebda4fa1b4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'migration_context' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Start _get_guest_xml network_info=[{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "vif_mac": "fa:16:3e:6b:c7:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9544747d-a446-4401-9c84-2ad5a75ca6bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ee146d75-d9f6-4924-8627-1f141b2bccc7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaoBLYvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '012c74eb-e477-42dc-a04e-908b51e82de1', 'attached_at': '', 'detached_at': '', 'volume_id': 'c3549704-2d58-4476-88a0-72b25fd7ddc7', 'serial': 'c3549704-2d58-4476-88a0-72b25fd7ddc7'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'resources' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'numa_topology' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:12:19 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Creating image(s)
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Ensure instance console log exists: /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Start _get_guest_xml network_info=[{"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '745f1f67-478f-45f6-98e1-17a75ff0f962', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqOGJcwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd5b2095f-df4e-4420-9dca-4552b10e3f3e', 'attached_at': '', 'detached_at': '', 'volume_id': '55e0936d-0dff-4421-a3a9-dd2194e9d086', 'serial': '55e0936d-0dff-4421-a3a9-dd2194e9d086'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:12:19 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:12:19 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:12:19 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:12:19 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqOGJcwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:12:19 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:19 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:19 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'vcpu_model' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaoBLYvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:12:19 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6861cc31-fdc8-4d5d-8cbb-816b8105b379]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:12:19 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf89a8c-503d-4295-a01d-085e85ab2f30]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086] added
Aug 15 02:12:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfeb39c-f827-427b-9dd8-59a4fabd37a1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[669d4027-3c0a-4fa5-9ce0-b7f15011d5f0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqOGJcwW {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqOGJcwW" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41475ab-63f9-4300-8e7d-c891c6f3b1e2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IqOGJcwW'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61053c8-1471-40b7-894a-d1bb3e114c0b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c4a063-23fe-42a2-9ff2-7adbf1a833c5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[073658ae-c3d2-4125-8886-2f90653ea428]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086, portal: 172.16.0.220,3260]
Aug 15 02:12:19 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086, portal: 172.16.0.220,3260] successful.
Aug 15 02:12:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd70a30-87e0-40b8-95c4-724962318360]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8593b76e-5981-4252-a22a-054161e95566]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:19 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b08ecb-712c-41e9-bd67-039b93a006bc]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:12:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqOGJcwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] <== connect_volume: return (1412ms) {'type': 'block', 'scsi_wwn': '23734633765363738', 'path': '/dev/sdg'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734633765363738', 'path': '/dev/sdg'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.362s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:20 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:20 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:12:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c840c0f1-3765-46bb-934e-a2d3cc17b316]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NaoBLYvF\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 02:12:20 user nova-compute[73121]: node.name = iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7
Aug 15 02:12:20 user nova-compute[73121]: node.tpgt = -1
Aug 15 02:12:20 user nova-compute[73121]: node.startup = automatic
Aug 15 02:12:20 user nova-compute[73121]: node.leading_login = No
Aug 15 02:12:20 user nova-compute[73121]: iface.iscsi_ifacename = default
Aug 15 02:12:20 user nova-compute[73121]: iface.net_ifacename = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.ipaddress = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.prefix_len = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.hwaddress = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.transport_name = tcp
Aug 15 02:12:20 user nova-compute[73121]: iface.initiatorname = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.state = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.vlan_id = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.vlan_priority = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.vlan_state = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.iface_num = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.mtu = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.port = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.bootproto = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.subnet_mask = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.gateway = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.dhcp_alt_client_id = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.dhcp_dns = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.dhcp_learn_iqn = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.dhcp_vendor_id_state = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.dhcp_vendor_id = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.dhcp_slp_da = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.fragmentation = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.gratuitous_arp = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.incoming_forwarding = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.tos_state = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.tos = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.ttl = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.delayed_ack = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.tcp_nagle = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.tcp_wsf_state = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.tcp_wsf = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.tcp_timer_scale = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.tcp_timestamp = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.redirect = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.def_task_mgmt_timeout = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.header_digest = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.data_digest = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.immediate_data = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.initial_r2t = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.data_seq_inorder = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.data_pdu_inorder = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.erl = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.max_receive_data_len = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.first_burst_len = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.max_outstanding_r2t = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.max_burst_len = 0
Aug 15 02:12:20 user nova-compute[73121]: iface.chap_auth = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.bidi_chap = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.strict_login_compliance = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.discovery_auth = <empty>
Aug 15 02:12:20 user nova-compute[73121]: iface.discovery_logout = <empty>
Aug 15 02:12:20 user nova-compute[73121]: node.discovery_address = <empty>
Aug 15 02:12:20 user nova-compute[73121]: node.discovery_port = 0
Aug 15 02:12:20 user nova-compute[73121]: node.discovery_type = static
Aug 15 02:12:20 user nova-compute[73121]: node.session.initial_cmdsn = 0
Aug 15 02:12:20 user nova-compute[73121]: node.session.initial_login_retry_max = 8
Aug 15 02:12:20 user nova-compute[73121]: node.session.xmit_thread_priority = -20
Aug 15 02:12:20 user nova-compute[73121]: node.session.cmds_max = 128
Aug 15 02:12:20 user nova-compute[73121]: node.session.queue_depth = 32
Aug 15 02:12:20 user nova-compute[73121]: node.session.nr_sessions = 1
Aug 15 02:12:20 user nova-compute[73121]: node.session.auth.authmethod = CHAP
Aug 15 02:12:20 user nova-compute[73121]: node.session.auth.username = NaoBLYvF
Aug 15 02:12:20 user nova-compute[73121]: node.session.auth.password = ***
Aug 15 02:12:20 user nova-compute[73121]: node.session.auth.username_in = <empty>
Aug 15 02:12:20 user nova-compute[73121]: node.session.auth.password_in = <empty>
Aug 15 02:12:20 user nova-compute[73121]: node.session.auth.chap_algs = MD5
Aug 15 02:12:20 user nova-compute[73121]: node.session.timeo.replacement_timeout = 120
Aug 15 02:12:20 user nova-compute[73121]: node.session.err_timeo.abort_timeout = 15
Aug 15 02:12:20 user nova-compute[73121]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 02:12:20 user nova-compute[73121]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 02:12:20 user nova-compute[73121]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.FastAbort = Yes
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.InitialR2T = No
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.ImmediateData = Yes
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.MaxConnections = 1
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 02:12:20 user nova-compute[73121]: node.session.iscsi.ERL = 0
Aug 15 02:12:20 user nova-compute[73121]: node.session.scan = manual
Aug 15 02:12:20 user nova-compute[73121]: node.session.reopen_max = 0
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].address = 172.16.0.220
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].port = 3260
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].startup = manual
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].tcp.window_size = 524288
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].tcp.type_of_service = 0
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].timeo.logout_timeout = 15
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].timeo.login_timeout = 15
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].timeo.auth_timeout = 45
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].iscsi.DataDigest = None
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].iscsi.IFMarker = No
Aug 15 02:12:20 user nova-compute[73121]: node.conn[0].iscsi.OFMarker = No
Aug 15 02:12:20 user nova-compute[73121]: # END RECORD
Aug 15 02:12:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1940753038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1940753038',id=30,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-1mrd2u0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:11:53Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=d5b2095f-df4e-4420-9dca-4552b10e3f3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:46:79,bridge_name='br-int',has_traffic_filtering=True,id=c423ec03-ba94-4691-bcc1-b7354e3b1a80,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc423ec03-ba') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG nova.objects.instance [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'pci_devices' on Instance uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:12:21 user nova-compute[73121]:   <uuid>d5b2095f-df4e-4420-9dca-4552b10e3f3e</uuid>
Aug 15 02:12:21 user nova-compute[73121]:   <name>instance-0000001e</name>
Aug 15 02:12:21 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:12:21 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:12:21 user nova-compute[73121]:   <metadata>
Aug 15 02:12:21 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:12:21 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1940753038</nova:name>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:12:19</nova:creationTime>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:12:21 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:12:21 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:owner>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:user uuid="4d8ef0b0581e4a10b066c15119bafde1">tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member</nova:user>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:project uuid="ea879c6a9d1f4d58998e077524a07225">tempest-ServerBootFromVolumeStableRescueTest-893410799</nova:project>
Aug 15 02:12:21 user nova-compute[73121]:       </nova:owner>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:ports>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:port uuid="c423ec03-ba94-4691-bcc1-b7354e3b1a80">
Aug 15 02:12:21 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:12:21 user nova-compute[73121]:         </nova:port>
Aug 15 02:12:21 user nova-compute[73121]:       </nova:ports>
Aug 15 02:12:21 user nova-compute[73121]:     </nova:instance>
Aug 15 02:12:21 user nova-compute[73121]:   </metadata>
Aug 15 02:12:21 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:12:21 user nova-compute[73121]:     <system>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="serial">d5b2095f-df4e-4420-9dca-4552b10e3f3e</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="uuid">d5b2095f-df4e-4420-9dca-4552b10e3f3e</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:12:21 user nova-compute[73121]:     </system>
Aug 15 02:12:21 user nova-compute[73121]:   </sysinfo>
Aug 15 02:12:21 user nova-compute[73121]:   <os>
Aug 15 02:12:21 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:12:21 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:12:21 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:12:21 user nova-compute[73121]:   </os>
Aug 15 02:12:21 user nova-compute[73121]:   <features>
Aug 15 02:12:21 user nova-compute[73121]:     <acpi/>
Aug 15 02:12:21 user nova-compute[73121]:     <apic/>
Aug 15 02:12:21 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:12:21 user nova-compute[73121]:   </features>
Aug 15 02:12:21 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:12:21 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:12:21 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:12:21 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:12:21 user nova-compute[73121]:   </clock>
Aug 15 02:12:21 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:12:21 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:12:21 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:12:21 user nova-compute[73121]:   </cpu>
Aug 15 02:12:21 user nova-compute[73121]:   <devices>
Aug 15 02:12:21 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:12:21 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:12:21 user nova-compute[73121]:       <source dev="/dev/sdg"/>
Aug 15 02:12:21 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:12:21 user nova-compute[73121]:       <serial>55e0936d-0dff-4421-a3a9-dd2194e9d086</serial>
Aug 15 02:12:21 user nova-compute[73121]:     </disk>
Aug 15 02:12:21 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:12:21 user nova-compute[73121]:       <mac address="fa:16:3e:25:46:79"/>
Aug 15 02:12:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:12:21 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:12:21 user nova-compute[73121]:       <target dev="tapc423ec03-ba"/>
Aug 15 02:12:21 user nova-compute[73121]:     </interface>
Aug 15 02:12:21 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:12:21 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/console.log" append="off"/>
Aug 15 02:12:21 user nova-compute[73121]:     </serial>
Aug 15 02:12:21 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:12:21 user nova-compute[73121]:     <video>
Aug 15 02:12:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:12:21 user nova-compute[73121]:     </video>
Aug 15 02:12:21 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:12:21 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:12:21 user nova-compute[73121]:     </rng>
Aug 15 02:12:21 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:12:21 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:12:21 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:12:21 user nova-compute[73121]:     </memballoon>
Aug 15 02:12:21 user nova-compute[73121]:   </devices>
Aug 15 02:12:21 user nova-compute[73121]: </domain>
Aug 15 02:12:21 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1940753038',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1940753038',id=30,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-1mrd2u0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:11:53Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=d5b2095f-df4e-4420-9dca-4552b10e3f3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:46:79,bridge_name='br-int',has_traffic_filtering=True,id=c423ec03-ba94-4691-bcc1-b7354e3b1a80,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc423ec03-ba') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_vif [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:46:79,bridge_name='br-int',has_traffic_filtering=True,id=c423ec03-ba94-4691-bcc1-b7354e3b1a80,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc423ec03-ba') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee479db-756c-41cc-8a1c-10bda1732874]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc423ec03-ba, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc423ec03-ba, col_values=(('external_ids', {'iface-id': 'c423ec03-ba94-4691-bcc1-b7354e3b1a80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:46:79', 'vm-uuid': 'd5b2095f-df4e-4420-9dca-4552b10e3f3e'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d059864-593f-4b20-b93b-2b73f7f12593]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaoBLYvF {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:21 user nova-compute[73121]: INFO os_vif [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:46:79,bridge_name='br-int',has_traffic_filtering=True,id=c423ec03-ba94-4691-bcc1-b7354e3b1a80,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc423ec03-ba')
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NaoBLYvF" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c04cba6-6706-45b6-9909-ba1b0ed798a5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NaoBLYvF'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[484f8c3a-591e-4323-9b91-4e0de262b497]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No VIF found with MAC fa:16:3e:25:46:79, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6613c2-fbe1-4298-8893-fef7228439ce]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:21 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] HCTL ('37', '0', '0', 0) found on session 32 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf037ac-c868-4c0a-b6ea-ffbf4c33d065]: (4, ('0 0 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Searching for a device in session 32 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaoBLYvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] <== connect_volume: return (1548ms) {'type': 'block', 'scsi_wwn': '26161346530353562', 'path': '/dev/sdf'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161346530353562', 'path': '/dev/sdf'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-746478903',display_name='tempest-ServerStableDeviceRescueTest-server-746478903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-746478903',id=23,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRwC8YL0jzZcbZMy9BtwKYjRwTz5ZrvOud6U5kgAzyZd8PjwLBMW46Zur0A8UvbTHnO18lr6q0qGSDAbNtQaNyNLrJ+lB9yNbU79Mn6ZlJzF6PuSExtaX1uEuGdot54jQ==',key_name='tempest-keypair-1186469442',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:08:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d90d41f123f4ef9bbaea3ca67b76e36',ramdisk_id='',reservation_id='r-zzr9ciut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-232377404',owner_user_name='tempest-ServerStableDeviceRescueTest-232377404-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:10:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd426e7c0ae4b179e08d2c6cbeb055d',uuid=012c74eb-e477-42dc-a04e-908b51e82de1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "vif_mac": "fa:16:3e:6b:c7:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Converting VIF {"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "vif_mac": "fa:16:3e:6b:c7:ac"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:c7:ac,bridge_name='br-int',has_traffic_filtering=True,id=eeb90096-6720-4d4b-954c-f03f3eeba489,network=Network(80d553b0-a83b-4da0-b037-c5c21ca2872f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb90096-67') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'pci_devices' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:12:21 user nova-compute[73121]:   <uuid>012c74eb-e477-42dc-a04e-908b51e82de1</uuid>
Aug 15 02:12:21 user nova-compute[73121]:   <name>instance-00000017</name>
Aug 15 02:12:21 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:12:21 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:12:21 user nova-compute[73121]:   <metadata>
Aug 15 02:12:21 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:12:21 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-746478903</nova:name>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:12:19</nova:creationTime>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:12:21 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:12:21 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:owner>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:user uuid="dcd426e7c0ae4b179e08d2c6cbeb055d">tempest-ServerStableDeviceRescueTest-232377404-project-member</nova:user>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:project uuid="4d90d41f123f4ef9bbaea3ca67b76e36">tempest-ServerStableDeviceRescueTest-232377404</nova:project>
Aug 15 02:12:21 user nova-compute[73121]:       </nova:owner>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:12:21 user nova-compute[73121]:       <nova:ports>
Aug 15 02:12:21 user nova-compute[73121]:         <nova:port uuid="eeb90096-6720-4d4b-954c-f03f3eeba489">
Aug 15 02:12:21 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:12:21 user nova-compute[73121]:         </nova:port>
Aug 15 02:12:21 user nova-compute[73121]:       </nova:ports>
Aug 15 02:12:21 user nova-compute[73121]:     </nova:instance>
Aug 15 02:12:21 user nova-compute[73121]:   </metadata>
Aug 15 02:12:21 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:12:21 user nova-compute[73121]:     <system>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="serial">012c74eb-e477-42dc-a04e-908b51e82de1</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="uuid">012c74eb-e477-42dc-a04e-908b51e82de1</entry>
Aug 15 02:12:21 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:12:21 user nova-compute[73121]:     </system>
Aug 15 02:12:21 user nova-compute[73121]:   </sysinfo>
Aug 15 02:12:21 user nova-compute[73121]:   <os>
Aug 15 02:12:21 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:12:21 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:12:21 user nova-compute[73121]:   </os>
Aug 15 02:12:21 user nova-compute[73121]:   <features>
Aug 15 02:12:21 user nova-compute[73121]:     <acpi/>
Aug 15 02:12:21 user nova-compute[73121]:     <apic/>
Aug 15 02:12:21 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:12:21 user nova-compute[73121]:   </features>
Aug 15 02:12:21 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:12:21 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:12:21 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:12:21 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:12:21 user nova-compute[73121]:   </clock>
Aug 15 02:12:21 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:12:21 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:12:21 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:12:21 user nova-compute[73121]:   </cpu>
Aug 15 02:12:21 user nova-compute[73121]:   <devices>
Aug 15 02:12:21 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:12:21 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:12:21 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk"/>
Aug 15 02:12:21 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:12:21 user nova-compute[73121]:     </disk>
Aug 15 02:12:21 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:12:21 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:12:21 user nova-compute[73121]:       <source dev="/dev/sdf"/>
Aug 15 02:12:21 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:12:21 user nova-compute[73121]:       <serial>c3549704-2d58-4476-88a0-72b25fd7ddc7</serial>
Aug 15 02:12:21 user nova-compute[73121]:     </disk>
Aug 15 02:12:21 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:12:21 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:12:21 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue"/>
Aug 15 02:12:21 user nova-compute[73121]:       <target dev="vdc" bus="virtio"/>
Aug 15 02:12:21 user nova-compute[73121]:       <boot order="1"/>
Aug 15 02:12:21 user nova-compute[73121]:     </disk>
Aug 15 02:12:21 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:12:21 user nova-compute[73121]:       <mac address="fa:16:3e:6b:c7:ac"/>
Aug 15 02:12:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:12:21 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:12:21 user nova-compute[73121]:       <target dev="tapeeb90096-67"/>
Aug 15 02:12:21 user nova-compute[73121]:     </interface>
Aug 15 02:12:21 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:12:21 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/console.log" append="off"/>
Aug 15 02:12:21 user nova-compute[73121]:     </serial>
Aug 15 02:12:21 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:12:21 user nova-compute[73121]:     <video>
Aug 15 02:12:21 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:12:21 user nova-compute[73121]:     </video>
Aug 15 02:12:21 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:12:21 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:12:21 user nova-compute[73121]:     </rng>
Aug 15 02:12:21 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:12:21 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:12:21 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:12:21 user nova-compute[73121]:     </memballoon>
Aug 15 02:12:21 user nova-compute[73121]:   </devices>
Aug 15 02:12:21 user nova-compute[73121]: </domain>
Aug 15 02:12:21 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:12:21 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Instance destroyed successfully.
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:12:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] No VIF found with MAC fa:16:3e:6b:c7:ac, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:12:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-04178818-8757-462c-beb6-c292bf12a362 req-d0e29bf3-70d8-4ba6-b59c-46cec9bc6801 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-04178818-8757-462c-beb6-c292bf12a362 req-d0e29bf3-70d8-4ba6-b59c-46cec9bc6801 service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-04178818-8757-462c-beb6-c292bf12a362 req-d0e29bf3-70d8-4ba6-b59c-46cec9bc6801 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-04178818-8757-462c-beb6-c292bf12a362 req-d0e29bf3-70d8-4ba6-b59c-46cec9bc6801 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-04178818-8757-462c-beb6-c292bf12a362 req-d0e29bf3-70d8-4ba6-b59c-46cec9bc6801 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:12:23 user nova-compute[73121]: WARNING nova.compute.manager [req-04178818-8757-462c-beb6-c292bf12a362 req-d0e29bf3-70d8-4ba6-b59c-46cec9bc6801 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state active and task_state rescuing.
Aug 15 02:12:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:12:26 user nova-compute[73121]: WARNING nova.compute.manager [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state active and task_state rescuing.
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:12:26 user nova-compute[73121]: WARNING nova.compute.manager [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state building and task_state spawning.
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:12:26 user nova-compute[73121]: WARNING nova.compute.manager [req-ad4e626d-937c-4894-9e25-b8df5c20e26b req-fc2f07a1-140a-4ad7-9018-2a6beb653c22 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state building and task_state spawning.
Aug 15 02:12:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065546.6452458, d5b2095f-df4e-4420-9dca-4552b10e3f3e => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:12:26 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] VM Resumed (Lifecycle Event)
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:12:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance spawned successfully.
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:12:26 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065546.6470122, d5b2095f-df4e-4420-9dca-4552b10e3f3e => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:12:26 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] VM Started (Lifecycle Event)
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:12:26 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for 012c74eb-e477-42dc-a04e-908b51e82de1 due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065546.7828803, 012c74eb-e477-42dc-a04e-908b51e82de1 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:12:26 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] VM Resumed (Lifecycle Event)
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0a6bd990-57be-4485-b28c-e3739c9905d4 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:12:26 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065546.7853007, 012c74eb-e477-42dc-a04e-908b51e82de1 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:12:26 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] VM Started (Lifecycle Event)
Aug 15 02:12:26 user nova-compute[73121]: INFO nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Took 7.41 seconds to spawn the instance on the hypervisor.
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:12:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:27 user nova-compute[73121]: INFO nova.compute.manager [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Took 35.10 seconds to build instance.
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-13abc751-54f2-4990-a729-bec4366e4e2c tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.279s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:12:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:31 user nova-compute[73121]: INFO nova.compute.manager [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Detaching volume 30fa2955-3b39-464a-8e34-0e160101b86c
Aug 15 02:12:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:31 user nova-compute[73121]: INFO nova.virt.block_device [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attempting to driver detach volume 30fa2955-3b39-464a-8e34-0e160101b86c from mountpoint /dev/vdb
Aug 15 02:12:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Attempting to detach device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:12:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:12:31 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:12:31 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:12:31 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:12:31 user nova-compute[73121]:   <serial>30fa2955-3b39-464a-8e34-0e160101b86c</serial>
Aug 15 02:12:31 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:12:31 user nova-compute[73121]: </disk>
Aug 15 02:12:31 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:12:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully detached device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the persistent domain config.
Aug 15 02:12:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:12:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:12:31 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:12:31 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:12:31 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:12:31 user nova-compute[73121]:   <serial>30fa2955-3b39-464a-8e34-0e160101b86c</serial>
Aug 15 02:12:31 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:12:31 user nova-compute[73121]: </disk>
Aug 15 02:12:31 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065552.0231297, afb831b1-b2b9-4771-a759-47fbaa2a0382 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:12:32 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully detached device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the live domain config.
Aug 15 02:12:32 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:12:32 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7146MB free_disk=25.142051696777344GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DfBwHEKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:12:32 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20db224-0852-4663-8c9f-0de9480f73f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3194d6-d9a5-4aec-aa93-58e21b8bf523]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:32 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc60c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c'): ({'sde'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Removing single pathed devices sde {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cb1cda-c071-4773-823d-d9087f4bdadb]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d49e530-380a-4673-8f8d-2faf283f6355]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Flushing IO for device /dev/sde {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac112bed-413b-4d30-8caa-9c1635c92ffa]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 012c74eb-e477-42dc-a04e-908b51e82de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7950f28-0893-49de-a560-bbc0791492b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance be6f8247-2be1-4add-92e9-54e4bef5c44c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance afb831b1-b2b9-4771-a759-47fbaa2a0382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a2ba430b-5100-4e64-9311-f5521a432292 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 00d2c851-39b9-40cb-8bac-785c954800cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance bc351c09-798d-4048-b80f-0dbf85344edb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d5b2095f-df4e-4420-9dca-4552b10e3f3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69283e7-63ff-440f-a986-b4c493139d5e]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[255690b9-a4d9-4094-afd0-9863dad09295]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef445bd-f4aa-4956-93be-658b6ef32411]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c, portal: 172.16.0.220,3260]
Aug 15 02:12:32 user nova-compute[73121]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c, portal: 172.16.0.220,3260] successful.
Aug 15 02:12:32 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30fa2955-3b39-464a-8e34-0e160101b86c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cef6a6-0bca-468b-980e-bb5de2a30388]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== disconnect_volume: return (346ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:12:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:12:33 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:12:33 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:12:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:12:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.804s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:33 user nova-compute[73121]: DEBUG nova.objects.instance [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-21047a40-de14-4e6f-9809-7f833da5b3b4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.318s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:34 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:34 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:12:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-58924dc1-9883-4d1a-b646-353126f63b31 req-78f23c75-be6e-4b7f-b9e9-5216d333690c service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received event network-changed-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:12:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-58924dc1-9883-4d1a-b646-353126f63b31 req-78f23c75-be6e-4b7f-b9e9-5216d333690c service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Refreshing instance network info cache due to event network-changed-ee0a5e67-7879-49b3-a54f-bc66eb6f1631. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:12:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-58924dc1-9883-4d1a-b646-353126f63b31 req-78f23c75-be6e-4b7f-b9e9-5216d333690c service nova] Acquiring lock "refresh_cache-a2ba430b-5100-4e64-9311-f5521a432292" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:12:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-58924dc1-9883-4d1a-b646-353126f63b31 req-78f23c75-be6e-4b7f-b9e9-5216d333690c service nova] Acquired lock "refresh_cache-a2ba430b-5100-4e64-9311-f5521a432292" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:12:45 user nova-compute[73121]: DEBUG nova.network.neutron [req-58924dc1-9883-4d1a-b646-353126f63b31 req-78f23c75-be6e-4b7f-b9e9-5216d333690c service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Refreshing network info cache for port ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:12:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-58924dc1-9883-4d1a-b646-353126f63b31 req-78f23c75-be6e-4b7f-b9e9-5216d333690c service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Updated VIF entry in instance network info cache for port ee0a5e67-7879-49b3-a54f-bc66eb6f1631. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:12:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-58924dc1-9883-4d1a-b646-353126f63b31 req-78f23c75-be6e-4b7f-b9e9-5216d333690c service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Updating instance_info_cache with network_info: [{"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:12:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-58924dc1-9883-4d1a-b646-353126f63b31 req-78f23c75-be6e-4b7f-b9e9-5216d333690c service nova] Releasing lock "refresh_cache-a2ba430b-5100-4e64-9311-f5521a432292" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:12:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:12:49 user nova-compute[73121]: INFO nova.compute.manager [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Attaching volume 98aa12d9-e0bd-4163-9656-effebc990d04 to /dev/vdb
Aug 15 02:12:49 user nova-compute[73121]: DEBUG os_brick.utils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adf342e-1f7f-4805-9428-e9769cfa9aeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbfd4c1-c6c2-4483-ae7f-7aab27ed1e2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9072c715-158d-4995-8457-8866aadd0df5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a81e6f2-5cdc-481e-819e-317b44709432]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:12:49 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:12:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[429ccc8e-dcf9-401f-8fca-49109f0d9c03]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG os_brick.utils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:12:49 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Updating existing volume attachment record: a613ee90-99ff-4073-b17b-0f3c2b458255 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:12:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrdLuoTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:12:59 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:59 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:12:59 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[273bc5ad-dc93-42a6-a740-66f9afb7114a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:12:59 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a475859d-91ab-42a9-956c-5e84eb08d1e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04] added
Aug 15 02:12:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[722d5db0-a150-45b9-91a9-ec393ab30380]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2956c4f-527d-46ab-a38c-5ffdae98e4ba]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrdLuoTX {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wrdLuoTX" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddbfa7b-b8ce-4ab3-bb0f-64c5308f855f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wrdLuoTX'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b709ab8-4068-4fdd-ac08-f2e97ef22bfe]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[af33b54e-1860-4054-ab97-ae9ec7a5aa2c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2882b294-8c77-4f16-970a-43ff5821b50b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04, portal: 172.16.0.220,3260]
Aug 15 02:12:59 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04, portal: 172.16.0.220,3260] successful.
Aug 15 02:12:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[37638f19-c7c4-4131-ba5f-dc11f81933d9]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[65afdae2-c8c5-43a2-8871-c89b0aa08678]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)
Aug 15 02:12:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea7331a-fa94-4af0-99da-4e47afacd5da]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:12:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrdLuoTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:13:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23734383837633063', 'path': '/dev/sde'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734383837633063', 'path': '/dev/sde'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:13:00 user nova-compute[73121]: DEBUG nova.objects.instance [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:13:00 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:00 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:13:00 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:13:00 user nova-compute[73121]:   <serial>98aa12d9-e0bd-4163-9656-effebc990d04</serial>
Aug 15 02:13:00 user nova-compute[73121]: </disk>
Aug 15 02:13:00 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:13:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No VIF found with MAC fa:16:3e:0d:7f:71, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:13:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-482315ba-9d58-47fe-a937-05fd5ab50721 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.975s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG nova.objects.instance [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:06 user nova-compute[73121]: INFO nova.compute.manager [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Attaching volume 6f4362d6-913b-447d-9bd7-a0c8f558c26b to /dev/vdc
Aug 15 02:13:06 user nova-compute[73121]: DEBUG os_brick.utils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d2196e-497b-4a83-9c06-64e89bbd5543]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[815929f1-0d95-4bfb-a6ce-b0082c0d0c6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[771a7133-a262-42b4-9837-1f4713b353d4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[713b71e6-763c-4e98-810b-999cd6720516]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:06 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:13:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dc2624-0244-461a-ba3c-0efbbd9e6af5]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG os_brick.utils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:06 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Updating existing volume attachment record: c6af0939-58a2-4338-b5d0-5abfd9f2c4d5 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:13:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-537a47d6-169f-4bd6-8ae8-57a57eaeb53b req-b3b41058-7116-47a1-83d2-0ecb96348608 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received event network-changed-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-537a47d6-169f-4bd6-8ae8-57a57eaeb53b req-b3b41058-7116-47a1-83d2-0ecb96348608 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Refreshing instance network info cache due to event network-changed-6cbc95d3-e345-4927-9abb-8e38f739af02. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:13:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-537a47d6-169f-4bd6-8ae8-57a57eaeb53b req-b3b41058-7116-47a1-83d2-0ecb96348608 service nova] Acquiring lock "refresh_cache-00d2c851-39b9-40cb-8bac-785c954800cf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:13:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-537a47d6-169f-4bd6-8ae8-57a57eaeb53b req-b3b41058-7116-47a1-83d2-0ecb96348608 service nova] Acquired lock "refresh_cache-00d2c851-39b9-40cb-8bac-785c954800cf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:13:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-537a47d6-169f-4bd6-8ae8-57a57eaeb53b req-b3b41058-7116-47a1-83d2-0ecb96348608 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Refreshing network info cache for port 6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:13:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-537a47d6-169f-4bd6-8ae8-57a57eaeb53b req-b3b41058-7116-47a1-83d2-0ecb96348608 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Updated VIF entry in instance network info cache for port 6cbc95d3-e345-4927-9abb-8e38f739af02. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:13:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-537a47d6-169f-4bd6-8ae8-57a57eaeb53b req-b3b41058-7116-47a1-83d2-0ecb96348608 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Updating instance_info_cache with network_info: [{"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-537a47d6-169f-4bd6-8ae8-57a57eaeb53b req-b3b41058-7116-47a1-83d2-0ecb96348608 service nova] Releasing lock "refresh_cache-00d2c851-39b9-40cb-8bac-785c954800cf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:13:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjnTUPhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:16 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:16 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:16 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f28055-677a-48ee-8530-c8e1bd2fbc19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:13:16 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65145be-2785-4e45-a458-50854217f255]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b] added
Aug 15 02:13:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[33575df2-dbc4-4270-b45a-d79844332a78]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0bb6fa-d40b-4b3d-a414-e2debad69576]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjnTUPhI {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjnTUPhI" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e602ff-a4bf-454e-a9d5-fa73fee6d8c7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bjnTUPhI'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa853c9-aadf-4ddd-ae43-868ea7e526ad]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2d5114-e267-4e47-a295-0ca42a1bb213]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3800ee-e0e7-4831-b390-bd7f8da26b2e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b, portal: 172.16.0.220,3260]
Aug 15 02:13:16 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b, portal: 172.16.0.220,3260] successful.
Aug 15 02:13:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65dabc5-6708-44ba-9b48-e4df01f3902f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16bc5c8-fd94-46b2-a267-31f760abea83]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b (non-flash)
Aug 15 02:13:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)
Aug 15 02:13:16 user nova-compute[73121]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b (non-flash)
Aug 15 02:13:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] HCTL ('39', '-', '-', 0) found on session 35 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9182047f-f032-48e8-b99d-17b98b722dbe]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Searching for a device in session 35 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:13:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjnTUPhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:13:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23262643466613161', 'path': '/dev/sdh'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262643466613161', 'path': '/dev/sdh'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:13:17 user nova-compute[73121]: DEBUG nova.objects.instance [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:13:17 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:17 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:13:17 user nova-compute[73121]:   <target dev="vdc" bus="virtio"/>
Aug 15 02:13:17 user nova-compute[73121]:   <serial>6f4362d6-913b-447d-9bd7-a0c8f558c26b</serial>
Aug 15 02:13:17 user nova-compute[73121]: </disk>
Aug 15 02:13:17 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:13:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] No VIF found with MAC fa:16:3e:0d:7f:71, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:13:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-df787a97-46a6-4a4f-80a2-e68a74191ff8 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.261s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:13:20 user nova-compute[73121]: INFO nova.compute.claims [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Claim successful on node user
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:20 user nova-compute[73121]: INFO nova.compute.manager [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Detaching volume 98aa12d9-e0bd-4163-9656-effebc990d04
Aug 15 02:13:20 user nova-compute[73121]: INFO nova.virt.block_device [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Attempting to driver detach volume 98aa12d9-e0bd-4163-9656-effebc990d04 from mountpoint /dev/vdb
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Attempting to detach device vdb from instance a2ba430b-5100-4e64-9311-f5521a432292 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:13:20 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:20 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:13:20 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:13:20 user nova-compute[73121]:   <serial>98aa12d9-e0bd-4163-9656-effebc990d04</serial>
Aug 15 02:13:20 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:13:20 user nova-compute[73121]: </disk>
Aug 15 02:13:20 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:13:20 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully detached device vdb from instance a2ba430b-5100-4e64-9311-f5521a432292 from the persistent domain config.
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a2ba430b-5100-4e64-9311-f5521a432292 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:13:20 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:20 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:13:20 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:13:20 user nova-compute[73121]:   <serial>98aa12d9-e0bd-4163-9656-effebc990d04</serial>
Aug 15 02:13:20 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:13:20 user nova-compute[73121]: </disk>
Aug 15 02:13:20 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.504s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:13:20 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.objects.instance [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'flavor' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065600.8058174, a2ba430b-5100-4e64-9311-f5521a432292 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:13:20 user nova-compute[73121]: INFO nova.virt.block_device [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Booting with volume snapshot 83224551-e4cb-4448-a741-3eddb44dc5f4 at /dev/vda
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:13:20 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully detached device vdb from instance a2ba430b-5100-4e64-9311-f5521a432292 from the live domain config.
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wrdLuoTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:20 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG nova.policy [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f9c4f2ffebb440cb88132a502d51811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3397dd14ca44c19dc4386aec30a9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c7cf4e-ad41-4c6c-8aaf-75cd560a81e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb122377-f764-4229-a192-39882ce98f63]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b (non-flash)
Aug 15 02:13:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 (non-flash)
Aug 15 02:13:20 user nova-compute[73121]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b (non-flash)
Aug 15 02:13:20 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc547910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04'): ({'sde'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Removing single pathed devices sde {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63a93c3-25ff-4948-bbbe-2c0dea2a3cc0]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:20 user nova-compute[73121]: INFO nova.compute.manager [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Attaching volume f7b28ba1-c5e0-47c2-9290-df72eb9b2575 to /dev/vdb
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39e9810-e0ce-4a28-8624-26be675ce3bd]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flushing IO for device /dev/sde {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1466e1-b15d-48b5-8621-04d54156e445]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:13:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211a74f-b88f-48ea-901d-0533bbe5d4d7]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.utils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf70c05-67fc-4927-a89f-d2b0d27c05a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a66e6b6-5e5b-4cae-a3f3-4908ccf72137]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2637c534-6fef-4dda-b908-ba44ab3f1180]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a014db-0032-4c71-a540-4a1989532fff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab59edd5-83d6-45ae-8302-b31206474bc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2932ab-2315-4e10-84d8-ccec487efba3]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04, portal: 172.16.0.220,3260]
Aug 15 02:13:21 user nova-compute[73121]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04, portal: 172.16.0.220,3260] successful.
Aug 15 02:13:21 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:21 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf2d39a-e7b1-48d4-a73c-b968b9efe553]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.utils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updating existing volume attachment record: a0535f39-d510-4517-9166-cde90d3a4fef {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98aa12d9-e0bd-4163-9656-effebc990d04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11d14f9-b8f6-43da-90a0-f3681bcff945]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== disconnect_volume: return (404ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:13:21 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Successfully created port: d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e97cbb7b-4665-4fa8-913b-141ad14d7735 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.990s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Successfully updated port: d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "refresh_cache-f1c5e851-4933-4db6-b7d5-ec2b417ec259" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquired lock "refresh_cache-f1c5e851-4933-4db6-b7d5-ec2b417ec259" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-11367423-d1e8-4d4a-aa27-ce6c902d8047 req-b3f07a39-bd20-4f43-b1f0-68096d082473 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received event network-changed-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-11367423-d1e8-4d4a-aa27-ce6c902d8047 req-b3f07a39-bd20-4f43-b1f0-68096d082473 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Refreshing instance network info cache due to event network-changed-d527648c-0376-4bff-a360-c4e83daa61cd. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-11367423-d1e8-4d4a-aa27-ce6c902d8047 req-b3f07a39-bd20-4f43-b1f0-68096d082473 service nova] Acquiring lock "refresh_cache-f1c5e851-4933-4db6-b7d5-ec2b417ec259" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:22 user nova-compute[73121]: INFO nova.compute.manager [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Detaching volume 6f4362d6-913b-447d-9bd7-a0c8f558c26b
Aug 15 02:13:22 user nova-compute[73121]: INFO nova.virt.block_device [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Attempting to driver detach volume 6f4362d6-913b-447d-9bd7-a0c8f558c26b from mountpoint /dev/vdc
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Attempting to detach device vdc from instance a2ba430b-5100-4e64-9311-f5521a432292 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:13:22 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:22 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:13:22 user nova-compute[73121]:   <target dev="vdc" bus="virtio"/>
Aug 15 02:13:22 user nova-compute[73121]:   <serial>6f4362d6-913b-447d-9bd7-a0c8f558c26b</serial>
Aug 15 02:13:22 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 02:13:22 user nova-compute[73121]: </disk>
Aug 15 02:13:22 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:13:22 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully detached device vdc from instance a2ba430b-5100-4e64-9311-f5521a432292 from the persistent domain config.
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a2ba430b-5100-4e64-9311-f5521a432292 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:13:22 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:22 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:13:22 user nova-compute[73121]:   <target dev="vdc" bus="virtio"/>
Aug 15 02:13:22 user nova-compute[73121]:   <serial>6f4362d6-913b-447d-9bd7-a0c8f558c26b</serial>
Aug 15 02:13:22 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 02:13:22 user nova-compute[73121]: </disk>
Aug 15 02:13:22 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Updating instance_info_cache with network_info: [{"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Releasing lock "refresh_cache-f1c5e851-4933-4db6-b7d5-ec2b417ec259" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Instance network_info: |[{"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-11367423-d1e8-4d4a-aa27-ce6c902d8047 req-b3f07a39-bd20-4f43-b1f0-68096d082473 service nova] Acquired lock "refresh_cache-f1c5e851-4933-4db6-b7d5-ec2b417ec259" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:13:22 user nova-compute[73121]: DEBUG nova.network.neutron [req-11367423-d1e8-4d4a-aa27-ce6c902d8047 req-b3f07a39-bd20-4f43-b1f0-68096d082473 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Refreshing network info cache for port d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065603.3285823, a2ba430b-5100-4e64-9311-f5521a432292 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:13:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully detached device vdc from instance a2ba430b-5100-4e64-9311-f5521a432292 from the live domain config.
Aug 15 02:13:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjnTUPhI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:23 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ec423e-23cd-458d-a394-e0ab53a23198]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7c0ef-385d-4c45-94ab-fdf9b06db484]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b (non-flash)
Aug 15 02:13:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:23 user nova-compute[73121]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b (non-flash)
Aug 15 02:13:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e20631d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b'): ({'sdh'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Removing single pathed devices sdh {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3227463-1a57-4857-8177-7db19e0c6d9d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b37affe-b412-42ad-bac4-c90eaea2fde1]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Flushing IO for device /dev/sdh {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[20401569-37f4-4717-b282-061ebbb12e70]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdcdd58-58a9-4820-a64d-bb4d49910c99]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb0f3dc-868f-4d3f-bbab-92fe20ebcd6a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8c0bd5-09fa-4bc3-9fec-d4ccf9543521]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b, portal: 172.16.0.220,3260]
Aug 15 02:13:23 user nova-compute[73121]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b, portal: 172.16.0.220,3260] successful.
Aug 15 02:13:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f4362d6-913b-447d-9bd7-a0c8f558c26b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[575f64f9-0697-4cbe-96e6-740da181c537]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] <== disconnect_volume: return (319ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG nova.network.neutron [req-11367423-d1e8-4d4a-aa27-ce6c902d8047 req-b3f07a39-bd20-4f43-b1f0-68096d082473 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Updated VIF entry in instance network info cache for port d527648c-0376-4bff-a360-c4e83daa61cd. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG nova.network.neutron [req-11367423-d1e8-4d4a-aa27-ce6c902d8047 req-b3f07a39-bd20-4f43-b1f0-68096d082473 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Updating instance_info_cache with network_info: [{"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-11367423-d1e8-4d4a-aa27-ce6c902d8047 req-b3f07a39-bd20-4f43-b1f0-68096d082473 service nova] Releasing lock "refresh_cache-f1c5e851-4933-4db6-b7d5-ec2b417ec259" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Skipping network cache update for instance because it is Building. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid ad8b33e3-c58c-4182-a43a-248f5f1face1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'flavor' on Instance uuid a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5f2b903b-1a2b-4375-9d20-9dabb6913d81 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.764s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updating instance_info_cache with network_info: [{"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:13:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:25 user nova-compute[73121]: INFO nova.compute.manager [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Terminating instance
Aug 15 02:13:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-a14dff88-3d1c-45f6-a7eb-a569801dafe6 req-76bf5d46-6423-4475-89c1-ebb1c00bd0e9 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received event network-vif-unplugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a14dff88-3d1c-45f6-a7eb-a569801dafe6 req-76bf5d46-6423-4475-89c1-ebb1c00bd0e9 service nova] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a14dff88-3d1c-45f6-a7eb-a569801dafe6 req-76bf5d46-6423-4475-89c1-ebb1c00bd0e9 service nova] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a14dff88-3d1c-45f6-a7eb-a569801dafe6 req-76bf5d46-6423-4475-89c1-ebb1c00bd0e9 service nova] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-a14dff88-3d1c-45f6-a7eb-a569801dafe6 req-76bf5d46-6423-4475-89c1-ebb1c00bd0e9 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] No waiting events found dispatching network-vif-unplugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-a14dff88-3d1c-45f6-a7eb-a569801dafe6 req-76bf5d46-6423-4475-89c1-ebb1c00bd0e9 service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received event network-vif-unplugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:25 user nova-compute[73121]: INFO nova.compute.manager [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attaching volume 1f30eb68-6ce5-4407-9204-51b4820d01fc to /dev/vdb
Aug 15 02:13:25 user nova-compute[73121]: DEBUG os_brick.utils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4dcd68-34b0-4f13-97e3-34c44b461e51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e55dcf-bf5d-4e0b-bcec-8f2486140492]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0c8c49-3838-4c2c-8523-e6423f21ee2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de5dd05-4e2c-4e4f-9780-2f5c3adec8e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:26 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[47da4131-662f-4636-9846-bc22a949e3d2]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.utils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updating existing volume attachment record: d87cdd23-bb62-4606-b99e-9373e95f26d4 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Instance destroyed successfully.
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lazy-loading 'resources' on Instance uuid a2ba430b-5100-4e64-9311-f5521a432292 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:10:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1455572834',display_name='tempest-AttachVolumeTestJSON-server-1455572834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1455572834',id=27,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBc+b4X0Y543gJA00QNYcOSjTxylIvvS11BMHQ15lzKw1VFbRLqvraCp4cJa2MckGdCUh/mTfZ+oG7sKqqgTZ7/EY/UzYuGlNgSIHDl8FndbrUqD5lYksKQ89etNBFPXsw==',key_name='tempest-keypair-1834838872',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:11:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16eb9362b3cd4011b8c7bae927a6edd6',ramdisk_id='',reservation_id='r-07ksgkrp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1774938081',owner_user_name='tempest-AttachVolumeTestJSON-1774938081-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:11:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8c555808f8b84962b88920df9f029648',uuid=a2ba430b-5100-4e64-9311-f5521a432292,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converting VIF {"id": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "address": "fa:16:3e:0d:7f:71", "network": {"id": "8a8ceb99-c534-421f-be65-ffbd1ab817ce", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-181978107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16eb9362b3cd4011b8c7bae927a6edd6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee0a5e67-78", "ovs_interfaceid": "ee0a5e67-7879-49b3-a54f-bc66eb6f1631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=ee0a5e67-7879-49b3-a54f-bc66eb6f1631,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0a5e67-78') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_vif [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=ee0a5e67-7879-49b3-a54f-bc66eb6f1631,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0a5e67-78') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee0a5e67-78, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:13:26 user nova-compute[73121]: INFO os_vif [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:7f:71,bridge_name='br-int',has_traffic_filtering=True,id=ee0a5e67-7879-49b3-a54f-bc66eb6f1631,network=Network(8a8ceb99-c534-421f-be65-ffbd1ab817ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee0a5e67-78')
Aug 15 02:13:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Deleting instance files /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292_del
Aug 15 02:13:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Deletion of /opt/stack/data/nova/instances/a2ba430b-5100-4e64-9311-f5521a432292_del complete
Aug 15 02:13:26 user nova-compute[73121]: INFO nova.compute.manager [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: a2ba430b-5100-4e64-9311-f5521a432292] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.utils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f784cf5c-7c05-4077-bc4b-396a58b6f8fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[43439644-b317-4904-944e-c52ca2fbfb94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74c9c8-f0a7-40f9-a553-82f120340e26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[54404397-298f-4e5f-b5ec-439596b42217]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:26 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8bd9a0-cc3c-4211-b6d4-6740d1bd396a]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG os_brick.utils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Updating existing volume attachment record: 255c48b2-99f0-47ce-91f3-5ddf52c3b034 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:13:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-39c45812-3707-4a08-aa91-97a6a8a04102 req-f8b8ac1f-e6f1-40b5-9ed1-5a2e8fffd41a service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received event network-vif-deleted-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:27 user nova-compute[73121]: INFO nova.compute.manager [req-39c45812-3707-4a08-aa91-97a6a8a04102 req-f8b8ac1f-e6f1-40b5-9ed1-5a2e8fffd41a service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Neutron deleted interface ee0a5e67-7879-49b3-a54f-bc66eb6f1631; detaching it from the instance and deleting it from the info cache
Aug 15 02:13:27 user nova-compute[73121]: DEBUG nova.network.neutron [req-39c45812-3707-4a08-aa91-97a6a8a04102 req-f8b8ac1f-e6f1-40b5-9ed1-5a2e8fffd41a service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:27 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Took 0.89 seconds to deallocate network for instance.
Aug 15 02:13:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-39c45812-3707-4a08-aa91-97a6a8a04102 req-f8b8ac1f-e6f1-40b5-9ed1-5a2e8fffd41a service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Detach interface failed, port_id=ee0a5e67-7879-49b3-a54f-bc66eb6f1631, reason: Instance a2ba430b-5100-4e64-9311-f5521a432292 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-4c30107b-a1d8-4900-be44-d872b324fd4d req-0dab20b3-d443-45d6-b0a0-3fbb4ae9782a service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received event network-vif-plugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4c30107b-a1d8-4900-be44-d872b324fd4d req-0dab20b3-d443-45d6-b0a0-3fbb4ae9782a service nova] Acquiring lock "a2ba430b-5100-4e64-9311-f5521a432292-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4c30107b-a1d8-4900-be44-d872b324fd4d req-0dab20b3-d443-45d6-b0a0-3fbb4ae9782a service nova] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4c30107b-a1d8-4900-be44-d872b324fd4d req-0dab20b3-d443-45d6-b0a0-3fbb4ae9782a service nova] Lock "a2ba430b-5100-4e64-9311-f5521a432292-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-4c30107b-a1d8-4900-be44-d872b324fd4d req-0dab20b3-d443-45d6-b0a0-3fbb4ae9782a service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] No waiting events found dispatching network-vif-plugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:27 user nova-compute[73121]: WARNING nova.compute.manager [req-4c30107b-a1d8-4900-be44-d872b324fd4d req-0dab20b3-d443-45d6-b0a0-3fbb4ae9782a service nova] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Received unexpected event network-vif-plugged-ee0a5e67-7879-49b3-a54f-bc66eb6f1631 for instance with vm_state deleted and task_state None.
Aug 15 02:13:27 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.597s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:28 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Deleted allocations for instance a2ba430b-5100-4e64-9311-f5521a432292
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2411a41b-b9b4-4ff4-9483-f32c9eb47764 tempest-AttachVolumeTestJSON-1774938081 tempest-AttachVolumeTestJSON-1774938081-project-member] Lock "a2ba430b-5100-4e64-9311-f5521a432292" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.779s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:13:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:13:29 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Error from libvirt while getting description of instance-0000001b: [Error Code 42] Domain not found: no domain with matching uuid 'a2ba430b-5100-4e64-9311-f5521a432292' (instance-0000001b): libvirt.libvirtError: Domain not found: no domain with matching uuid 'a2ba430b-5100-4e64-9311-f5521a432292' (instance-0000001b)
Aug 15 02:13:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:30 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:13:30 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7160MB free_disk=25.125732421875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 012c74eb-e477-42dc-a04e-908b51e82de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7950f28-0893-49de-a560-bbc0791492b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance be6f8247-2be1-4add-92e9-54e4bef5c44c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance afb831b1-b2b9-4771-a759-47fbaa2a0382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 00d2c851-39b9-40cb-8bac-785c954800cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance bc351c09-798d-4048-b80f-0dbf85344edb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d5b2095f-df4e-4420-9dca-4552b10e3f3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1c5e851-4933-4db6-b7d5-ec2b417ec259 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:13:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdeowFiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:31 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:31 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:31 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccf9562-6042-40f3-abee-9e968ec3d01b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:13:31 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cd5ad9-fe5f-4f89-b27f-52db1ba3cd56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575] added
Aug 15 02:13:31 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a7141-43f2-4f35-ab06-76da2db4a080]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d1c12e-71a4-40af-8dce-c5b94cfcbecd]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdeowFiM {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdeowFiM" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d9fa49-486f-4e8d-8acb-7dc5e6da9b88]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xdeowFiM'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8242ea6a-405d-4717-93f2-e634a925cc52]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91da66d-b0de-4827-a99b-09a5066e957f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e6b55f-2e23-4e1c-84ef-3ec224aa4b99]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260]
Aug 15 02:13:31 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260] successful.
Aug 15 02:13:31 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a63b96-5dae-4f30-a0be-514489b1cc8f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d6d8d7-9b1a-49cc-965a-3ae93e87d3f0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:31 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cdab55-63ae-46ff-8e93-b5f57637c2a0]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:13:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdeowFiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:13:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23363643034376132', 'path': '/dev/sde'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363643034376132', 'path': '/dev/sde'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:13:32 user nova-compute[73121]: DEBUG nova.objects.instance [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'flavor' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:13:32 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:32 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:13:32 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:13:32 user nova-compute[73121]:   <serial>f7b28ba1-c5e0-47c2-9290-df72eb9b2575</serial>
Aug 15 02:13:32 user nova-compute[73121]: </disk>
Aug 15 02:13:32 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:13:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No VIF found with MAC fa:16:3e:cb:f3:fa, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:13:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4b8e86a2-4cc5-4c14-9024-4a5542325ac6 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.672s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:13:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onjwOadF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:35 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:35 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:36 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16934c2-c960-4e98-a399-b9167f0ae9cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:13:36 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dc4e35-f2f3-4f23-bf23-a2cb1b711488]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc] added
Aug 15 02:13:36 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff39ce65-d62b-4068-83b1-a0689ea1e148]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ae3319-d59d-46ce-82bb-9f209299a222]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v onjwOadF {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v onjwOadF" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[794711cb-7e61-4b41-97fc-f14d6759f00a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'onjwOadF'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4743de95-e096-449a-9332-6231ffc36a70]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a244f69-fec8-4987-8472-7d2ef82cb0f9]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[de16aba3-7fdc-4ee5-b95b-98f72b3708b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc, portal: 172.16.0.220,3260]
Aug 15 02:13:36 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc, portal: 172.16.0.220,3260] successful.
Aug 15 02:13:36 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bb16e0-97ed-40c5-98ae-057b6298660a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecd129f-a2ba-4b4a-9800-4c5c898df8cb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)
Aug 15 02:13:36 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:36 user nova-compute[73121]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)
Aug 15 02:13:36 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] HCTL ('39', '-', '-', 0) found on session 37 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edc28b7-664a-4a0d-bc37-6bf8e180e99b]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:13:36 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Creating image(s)
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Ensure instance console log exists: /opt/stack/data/nova/instances/f1c5e851-4933-4db6-b7d5-ec2b417ec259/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Start _get_guest_xml network_info=[{"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T02:13:10Z,direct_url=<?>,disk_format='qcow2',id=b8476d0a-3d15-4067-9de8-a31854efe25d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1611265969',owner='2e3397dd14ca44c19dc4386aec30a9a4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T02:13:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '255c48b2-99f0-47ce-91f3-5ddf52c3b034', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxUKSLFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f1c5e851-4933-4db6-b7d5-ec2b417ec259', 'attached_at': '', 'detached_at': '', 'volume_id': '97d60439-7cf9-40fc-9af2-fd340caa9229', 'serial': '97d60439-7cf9-40fc-9af2-fd340caa9229'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:13:36 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:13:36 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T02:13:10Z,direct_url=<?>,disk_format='qcow2',id=b8476d0a-3d15-4067-9de8-a31854efe25d,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1611265969',owner='2e3397dd14ca44c19dc4386aec30a9a4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T02:13:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxUKSLFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:36 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching for a device in session 37 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onjwOadF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23664666233653636', 'path': '/dev/sdh'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664666233653636', 'path': '/dev/sdh'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.508s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:37 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:37 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0408977c-f27f-4b73-b105-3e35d57efeb4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:13:37 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:13:37 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:37 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:13:37 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:13:37 user nova-compute[73121]:   <serial>1f30eb68-6ce5-4407-9204-51b4820d01fc</serial>
Aug 15 02:13:37 user nova-compute[73121]: </disk>
Aug 15 02:13:37 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f07eac-46c3-4e71-ae9e-c000d597d2f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229] added
Aug 15 02:13:37 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3887a11-bc6d-4c35-b961-f099426219b5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebdea8b-3d21-406a-bb70-52610e2ec771]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxUKSLFY {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yxUKSLFY" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6894753-918b-4101-97f3-ccdb448942fa]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yxUKSLFY'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e57fc2e-fe42-4393-aee4-df5a4a45ddf5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[839c44f6-f1da-4712-aa02-4bbf9edc644b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)
Aug 15 02:13:37 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)
Aug 15 02:13:37 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8ab4ae-3c98-4878-aaa6-7676061efc8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229, portal: 172.16.0.220,3260]
Aug 15 02:13:37 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229, portal: 172.16.0.220,3260] successful.
Aug 15 02:13:37 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[137ec4ab-a0c6-4086-b66f-6169f5db14cd]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9159bc8-b85e-4bde-8a9a-04572fee3b49]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)
Aug 15 02:13:37 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:37 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] HCTL ('40', '-', '-', 0) found on session 38 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0ed857-eb41-4462-a176-b594785a6dd4]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching for a device in session 38 and hctl ['40', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No VIF found with MAC fa:16:3e:1c:c1:76, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a81d8891-4e75-4ddb-844f-fb3f525360f4 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.191s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching for a device in session 38 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxUKSLFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== connect_volume: return (1884ms) {'type': 'block', 'scsi_wwn': '23038333436333039', 'path': '/dev/sdi'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038333436333039', 'path': '/dev/sdi'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-806136339',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-806136339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-806136339',id=32,image_ref='b8476d0a-3d15-4067-9de8-a31854efe25d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuTwelD3DVunMc71bTDe33ErM2NFIPpNvhiwS7/4HKdd/F1v6CH8e/4PeD1CjyU/K65cWbfHLiYxPOzGyEHPiOUsN9/zdtF3l1CFX9RvvdstF4GRjfs0JJEPJtc5ADJUg==',key_name='tempest-keypair-952608114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-cdjwl0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-151395753',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=f1c5e851-4933-4db6-b7d5-ec2b417ec259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:29:93,bridge_name='br-int',has_traffic_filtering=True,id=d527648c-0376-4bff-a360-c4e83daa61cd,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd527648c-03') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'pci_devices' on Instance uuid f1c5e851-4933-4db6-b7d5-ec2b417ec259 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:13:38 user nova-compute[73121]:   <uuid>f1c5e851-4933-4db6-b7d5-ec2b417ec259</uuid>
Aug 15 02:13:38 user nova-compute[73121]:   <name>instance-00000020</name>
Aug 15 02:13:38 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:13:38 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:13:38 user nova-compute[73121]:   <metadata>
Aug 15 02:13:38 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:13:38 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:13:38 user nova-compute[73121]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-806136339</nova:name>
Aug 15 02:13:38 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:13:36</nova:creationTime>
Aug 15 02:13:38 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:13:38 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:13:38 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:13:38 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:13:38 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:13:38 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:13:38 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:13:38 user nova-compute[73121]:       <nova:owner>
Aug 15 02:13:38 user nova-compute[73121]:         <nova:user uuid="9f9c4f2ffebb440cb88132a502d51811">tempest-TestVolumeBootPattern-151395753-project-member</nova:user>
Aug 15 02:13:38 user nova-compute[73121]:         <nova:project uuid="2e3397dd14ca44c19dc4386aec30a9a4">tempest-TestVolumeBootPattern-151395753</nova:project>
Aug 15 02:13:38 user nova-compute[73121]:       </nova:owner>
Aug 15 02:13:38 user nova-compute[73121]:       <nova:root type="image" uuid="b8476d0a-3d15-4067-9de8-a31854efe25d"/>
Aug 15 02:13:38 user nova-compute[73121]:       <nova:ports>
Aug 15 02:13:38 user nova-compute[73121]:         <nova:port uuid="d527648c-0376-4bff-a360-c4e83daa61cd">
Aug 15 02:13:38 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 02:13:38 user nova-compute[73121]:         </nova:port>
Aug 15 02:13:38 user nova-compute[73121]:       </nova:ports>
Aug 15 02:13:38 user nova-compute[73121]:     </nova:instance>
Aug 15 02:13:38 user nova-compute[73121]:   </metadata>
Aug 15 02:13:38 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:13:38 user nova-compute[73121]:     <system>
Aug 15 02:13:38 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:13:38 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:13:38 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:13:38 user nova-compute[73121]:       <entry name="serial">f1c5e851-4933-4db6-b7d5-ec2b417ec259</entry>
Aug 15 02:13:38 user nova-compute[73121]:       <entry name="uuid">f1c5e851-4933-4db6-b7d5-ec2b417ec259</entry>
Aug 15 02:13:38 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:13:38 user nova-compute[73121]:     </system>
Aug 15 02:13:38 user nova-compute[73121]:   </sysinfo>
Aug 15 02:13:38 user nova-compute[73121]:   <os>
Aug 15 02:13:38 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:13:38 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:13:38 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:13:38 user nova-compute[73121]:   </os>
Aug 15 02:13:38 user nova-compute[73121]:   <features>
Aug 15 02:13:38 user nova-compute[73121]:     <acpi/>
Aug 15 02:13:38 user nova-compute[73121]:     <apic/>
Aug 15 02:13:38 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:13:38 user nova-compute[73121]:   </features>
Aug 15 02:13:38 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:13:38 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:13:38 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:13:38 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:13:38 user nova-compute[73121]:   </clock>
Aug 15 02:13:38 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:13:38 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:13:38 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:13:38 user nova-compute[73121]:   </cpu>
Aug 15 02:13:38 user nova-compute[73121]:   <devices>
Aug 15 02:13:38 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:13:38 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:38 user nova-compute[73121]:       <source dev="/dev/sdi"/>
Aug 15 02:13:38 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:13:38 user nova-compute[73121]:       <serial>97d60439-7cf9-40fc-9af2-fd340caa9229</serial>
Aug 15 02:13:38 user nova-compute[73121]:     </disk>
Aug 15 02:13:38 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:13:38 user nova-compute[73121]:       <mac address="fa:16:3e:eb:29:93"/>
Aug 15 02:13:38 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:13:38 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:13:38 user nova-compute[73121]:       <target dev="tapd527648c-03"/>
Aug 15 02:13:38 user nova-compute[73121]:     </interface>
Aug 15 02:13:38 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:13:38 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/f1c5e851-4933-4db6-b7d5-ec2b417ec259/console.log" append="off"/>
Aug 15 02:13:38 user nova-compute[73121]:     </serial>
Aug 15 02:13:38 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:13:38 user nova-compute[73121]:     <video>
Aug 15 02:13:38 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:13:38 user nova-compute[73121]:     </video>
Aug 15 02:13:38 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:13:38 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:13:38 user nova-compute[73121]:     </rng>
Aug 15 02:13:38 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:13:38 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:13:38 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:13:38 user nova-compute[73121]:     </memballoon>
Aug 15 02:13:38 user nova-compute[73121]:   </devices>
Aug 15 02:13:38 user nova-compute[73121]: </domain>
Aug 15 02:13:38 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-806136339',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-806136339',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-806136339',id=32,image_ref='b8476d0a-3d15-4067-9de8-a31854efe25d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuTwelD3DVunMc71bTDe33ErM2NFIPpNvhiwS7/4HKdd/F1v6CH8e/4PeD1CjyU/K65cWbfHLiYxPOzGyEHPiOUsN9/zdtF3l1CFX9RvvdstF4GRjfs0JJEPJtc5ADJUg==',key_name='tempest-keypair-952608114',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-cdjwl0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-151395753',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:13:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=f1c5e851-4933-4db6-b7d5-ec2b417ec259,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:29:93,bridge_name='br-int',has_traffic_filtering=True,id=d527648c-0376-4bff-a360-c4e83daa61cd,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd527648c-03') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG os_vif [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:29:93,bridge_name='br-int',has_traffic_filtering=True,id=d527648c-0376-4bff-a360-c4e83daa61cd,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd527648c-03') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd527648c-03, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd527648c-03, col_values=(('external_ids', {'iface-id': 'd527648c-0376-4bff-a360-c4e83daa61cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:29:93', 'vm-uuid': 'f1c5e851-4933-4db6-b7d5-ec2b417ec259'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:38 user nova-compute[73121]: INFO os_vif [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:29:93,bridge_name='br-int',has_traffic_filtering=True,id=d527648c-0376-4bff-a360-c4e83daa61cd,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd527648c-03')
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No VIF found with MAC fa:16:3e:eb:29:93, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:13:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:39 user nova-compute[73121]: INFO nova.compute.manager [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Detaching volume 1f30eb68-6ce5-4407-9204-51b4820d01fc
Aug 15 02:13:39 user nova-compute[73121]: INFO nova.virt.block_device [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attempting to driver detach volume 1f30eb68-6ce5-4407-9204-51b4820d01fc from mountpoint /dev/vdb
Aug 15 02:13:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Attempting to detach device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:13:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:13:39 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:39 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:13:39 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:13:39 user nova-compute[73121]:   <serial>1f30eb68-6ce5-4407-9204-51b4820d01fc</serial>
Aug 15 02:13:39 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:13:39 user nova-compute[73121]: </disk>
Aug 15 02:13:39 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:13:39 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully detached device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the persistent domain config.
Aug 15 02:13:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:13:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:13:39 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:39 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:13:39 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:13:39 user nova-compute[73121]:   <serial>1f30eb68-6ce5-4407-9204-51b4820d01fc</serial>
Aug 15 02:13:39 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:13:39 user nova-compute[73121]: </disk>
Aug 15 02:13:39 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-cb810071-a45d-4907-a1ef-1aac61ea3752 req-8d0bfa9c-ee0b-4403-8282-49e2c2eae122 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received event network-vif-plugged-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cb810071-a45d-4907-a1ef-1aac61ea3752 req-8d0bfa9c-ee0b-4403-8282-49e2c2eae122 service nova] Acquiring lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cb810071-a45d-4907-a1ef-1aac61ea3752 req-8d0bfa9c-ee0b-4403-8282-49e2c2eae122 service nova] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cb810071-a45d-4907-a1ef-1aac61ea3752 req-8d0bfa9c-ee0b-4403-8282-49e2c2eae122 service nova] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-cb810071-a45d-4907-a1ef-1aac61ea3752 req-8d0bfa9c-ee0b-4403-8282-49e2c2eae122 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] No waiting events found dispatching network-vif-plugged-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:40 user nova-compute[73121]: WARNING nova.compute.manager [req-cb810071-a45d-4907-a1ef-1aac61ea3752 req-8d0bfa9c-ee0b-4403-8282-49e2c2eae122 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received unexpected event network-vif-plugged-d527648c-0376-4bff-a360-c4e83daa61cd for instance with vm_state building and task_state spawning.
Aug 15 02:13:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065620.4874272, afb831b1-b2b9-4771-a759-47fbaa2a0382 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:13:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully detached device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the live domain config.
Aug 15 02:13:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'onjwOadF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:40 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66ef23b-ca9f-49f8-a298-51cceb57c515]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c92605-e74b-41ed-bfe3-f66e1ab0f739]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc (non-flash)
Aug 15 02:13:40 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:40 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e207891b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc'): ({'sdh'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Removing single pathed devices sdh {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f777fe9-8ea5-45fe-af97-152632ad3c2e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fdc363-1237-4a35-810c-4f01b61c085a]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Flushing IO for device /dev/sdh {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65e21cb-d7b8-496a-bc08-1e73eae16c9a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f8c80-2b8b-46a9-bf1c-9cdcc766d20c]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fc7036-841a-4278-a89c-394e23d4cb2f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b336cf08-8386-4716-96d9-49cbf8278e25]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc, portal: 172.16.0.220,3260]
Aug 15 02:13:40 user nova-compute[73121]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc, portal: 172.16.0.220,3260] successful.
Aug 15 02:13:40 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f30eb68-6ce5-4407-9204-51b4820d01fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0eb7d57-0d61-4cc3-b860-ab7327390164]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== disconnect_volume: return (332ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:13:41 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065606.2660136, a2ba430b-5100-4e64-9311-f5521a432292 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:13:41 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: a2ba430b-5100-4e64-9311-f5521a432292] VM Stopped (Lifecycle Event)
Aug 15 02:13:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-485e09fc-05fa-4371-9786-b3d2fc902c35 None None] [instance: a2ba430b-5100-4e64-9311-f5521a432292] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:13:41 user nova-compute[73121]: DEBUG nova.objects.instance [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3799a0f2-767d-488c-86e6-ad85bd11c60f tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.017s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-625e5b07-dfac-4d7b-8f5f-353b0b73bd1f req-2a1aabbf-9577-40da-bd85-409f79a6334e service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received event network-vif-plugged-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-625e5b07-dfac-4d7b-8f5f-353b0b73bd1f req-2a1aabbf-9577-40da-bd85-409f79a6334e service nova] Acquiring lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-625e5b07-dfac-4d7b-8f5f-353b0b73bd1f req-2a1aabbf-9577-40da-bd85-409f79a6334e service nova] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-625e5b07-dfac-4d7b-8f5f-353b0b73bd1f req-2a1aabbf-9577-40da-bd85-409f79a6334e service nova] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-625e5b07-dfac-4d7b-8f5f-353b0b73bd1f req-2a1aabbf-9577-40da-bd85-409f79a6334e service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] No waiting events found dispatching network-vif-plugged-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:42 user nova-compute[73121]: WARNING nova.compute.manager [req-625e5b07-dfac-4d7b-8f5f-353b0b73bd1f req-2a1aabbf-9577-40da-bd85-409f79a6334e service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received unexpected event network-vif-plugged-d527648c-0376-4bff-a360-c4e83daa61cd for instance with vm_state building and task_state spawning.
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065622.6828618, f1c5e851-4933-4db6-b7d5-ec2b417ec259 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:13:42 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] VM Resumed (Lifecycle Event)
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:13:42 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Instance spawned successfully.
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:13:42 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065622.6859198, f1c5e851-4933-4db6-b7d5-ec2b417ec259 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:13:42 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] VM Started (Lifecycle Event)
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:13:42 user nova-compute[73121]: INFO nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:13:42 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:13:42 user nova-compute[73121]: INFO nova.compute.manager [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Took 22.78 seconds to build instance.
Aug 15 02:13:42 user nova-compute[73121]: INFO nova.compute.manager [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Rescuing
Aug 15 02:13:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquired lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:13:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e520b6bd-2ff0-43d2-9237-f7922e5a2c7a tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.939s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Updating instance_info_cache with network_info: [{"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Releasing lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:13:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-72b19ea7-47b4-495b-8ad4-7033e065206c req-4ada12ab-861d-4757-a2aa-57de1b286ee3 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-unplugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-72b19ea7-47b4-495b-8ad4-7033e065206c req-4ada12ab-861d-4757-a2aa-57de1b286ee3 service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-72b19ea7-47b4-495b-8ad4-7033e065206c req-4ada12ab-861d-4757-a2aa-57de1b286ee3 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-72b19ea7-47b4-495b-8ad4-7033e065206c req-4ada12ab-861d-4757-a2aa-57de1b286ee3 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-72b19ea7-47b4-495b-8ad4-7033e065206c req-4ada12ab-861d-4757-a2aa-57de1b286ee3 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-unplugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:44 user nova-compute[73121]: WARNING nova.compute.manager [req-72b19ea7-47b4-495b-8ad4-7033e065206c req-4ada12ab-861d-4757-a2aa-57de1b286ee3 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-unplugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state active and task_state rescuing.
Aug 15 02:13:44 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance destroyed successfully.
Aug 15 02:13:44 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Attempting a stable device rescue
Aug 15 02:13:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73121) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance directory exists: not creating {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 02:13:44 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Creating image(s)
Aug 15 02:13:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "/opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "/opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "/opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'trusted_certs' on Instance uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "38b97932018985ca76932c32ce5019b9575169c2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "38b97932018985ca76932c32ce5019b9575169c2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2.part --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG nova.virt.images [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] 5b757d04-0d75-4d64-b05c-79cd593240a1 was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2.part /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing instance network info cache due to event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] Acquiring lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] Acquired lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2.part /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2.converted" returned: 0 in 0.755s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2.converted --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "38b97932018985ca76932c32ce5019b9575169c2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.599s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "38b97932018985ca76932c32ce5019b9575169c2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "38b97932018985ca76932c32ce5019b9575169c2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2 --force-share --output=json" returned: 0 in 0.214s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2,backing_fmt=raw /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2,backing_fmt=raw /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue" returned: 0 in 0.060s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "38b97932018985ca76932c32ce5019b9575169c2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'migration_context' on Instance uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Start _get_guest_xml network_info=[{"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "vif_mac": "fa:16:3e:25:46:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5b757d04-0d75-4d64-b05c-79cd593240a1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '745f1f67-478f-45f6-98e1-17a75ff0f962', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqOGJcwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'd5b2095f-df4e-4420-9dca-4552b10e3f3e', 'attached_at': '', 'detached_at': '', 'volume_id': '55e0936d-0dff-4421-a3a9-dd2194e9d086', 'serial': '55e0936d-0dff-4421-a3a9-dd2194e9d086'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'resources' on Instance uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'numa_topology' on Instance uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:47 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:13:47 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'vcpu_model' on Instance uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqOGJcwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:47 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:47 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:47 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63d631b-82c9-4190-8de2-7d2ea540fa0b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = IqOGJcwW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 02:13:47 user nova-compute[73121]: node.name = iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086
Aug 15 02:13:47 user nova-compute[73121]: node.tpgt = -1
Aug 15 02:13:47 user nova-compute[73121]: node.startup = automatic
Aug 15 02:13:47 user nova-compute[73121]: node.leading_login = No
Aug 15 02:13:47 user nova-compute[73121]: iface.iscsi_ifacename = default
Aug 15 02:13:47 user nova-compute[73121]: iface.net_ifacename = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.ipaddress = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.prefix_len = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.hwaddress = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.transport_name = tcp
Aug 15 02:13:47 user nova-compute[73121]: iface.initiatorname = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.state = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.vlan_id = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.vlan_priority = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.vlan_state = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.iface_num = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.mtu = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.port = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.bootproto = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.subnet_mask = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.gateway = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.dhcp_alt_client_id = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.dhcp_dns = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.dhcp_learn_iqn = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.dhcp_vendor_id_state = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.dhcp_vendor_id = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.dhcp_slp_da = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.fragmentation = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.gratuitous_arp = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.incoming_forwarding = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.tos_state = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.tos = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.ttl = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.delayed_ack = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.tcp_nagle = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.tcp_wsf_state = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.tcp_wsf = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.tcp_timer_scale = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.tcp_timestamp = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.redirect = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.def_task_mgmt_timeout = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.header_digest = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.data_digest = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.immediate_data = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.initial_r2t = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.data_seq_inorder = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.data_pdu_inorder = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.erl = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.max_receive_data_len = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.first_burst_len = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.max_outstanding_r2t = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.max_burst_len = 0
Aug 15 02:13:47 user nova-compute[73121]: iface.chap_auth = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.bidi_chap = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.strict_login_compliance = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.discovery_auth = <empty>
Aug 15 02:13:47 user nova-compute[73121]: iface.discovery_logout = <empty>
Aug 15 02:13:47 user nova-compute[73121]: node.discovery_address = <empty>
Aug 15 02:13:47 user nova-compute[73121]: node.discovery_port = 0
Aug 15 02:13:47 user nova-compute[73121]: node.discovery_type = static
Aug 15 02:13:47 user nova-compute[73121]: node.session.initial_cmdsn = 0
Aug 15 02:13:47 user nova-compute[73121]: node.session.initial_login_retry_max = 8
Aug 15 02:13:47 user nova-compute[73121]: node.session.xmit_thread_priority = -20
Aug 15 02:13:47 user nova-compute[73121]: node.session.cmds_max = 128
Aug 15 02:13:47 user nova-compute[73121]: node.session.queue_depth = 32
Aug 15 02:13:47 user nova-compute[73121]: node.session.nr_sessions = 1
Aug 15 02:13:47 user nova-compute[73121]: node.session.auth.authmethod = CHAP
Aug 15 02:13:47 user nova-compute[73121]: node.session.auth.username = IqOGJcwW
Aug 15 02:13:47 user nova-compute[73121]: node.session.auth.password = ***
Aug 15 02:13:47 user nova-compute[73121]: node.session.auth.username_in = <empty>
Aug 15 02:13:47 user nova-compute[73121]: node.session.auth.password_in = <empty>
Aug 15 02:13:47 user nova-compute[73121]: node.session.auth.chap_algs = MD5
Aug 15 02:13:47 user nova-compute[73121]: node.session.timeo.replacement_timeout = 120
Aug 15 02:13:47 user nova-compute[73121]: node.session.err_timeo.abort_timeout = 15
Aug 15 02:13:47 user nova-compute[73121]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 02:13:47 user nova-compute[73121]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 02:13:47 user nova-compute[73121]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.FastAbort = Yes
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.InitialR2T = No
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.ImmediateData = Yes
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.MaxConnections = 1
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 02:13:47 user nova-compute[73121]: node.session.iscsi.ERL = 0
Aug 15 02:13:47 user nova-compute[73121]: node.session.scan = manual
Aug 15 02:13:47 user nova-compute[73121]: node.session.reopen_max = 0
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].address = 172.16.0.220
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].port = 3260
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].startup = manual
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].tcp.window_size = 524288
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].tcp.type_of_service = 0
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].timeo.logout_timeout = 15
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].timeo.login_timeout = 15
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].timeo.auth_timeout = 45
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].iscsi.DataDigest = None
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].iscsi.IFMarker = No
Aug 15 02:13:47 user nova-compute[73121]: node.conn[0].iscsi.OFMarker = No
Aug 15 02:13:47 user nova-compute[73121]: # END RECORD
Aug 15 02:13:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updated VIF entry in instance network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updating instance_info_cache with network_info: [{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc9e2c8-2e12-4db8-a29f-2fad251bed7c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] Releasing lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:47 user nova-compute[73121]: WARNING nova.compute.manager [req-cef2ee76-c349-482e-8225-7905f2541312 req-6db7ea34-bc35-4b46-97d9-c08a0602343b service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state active and task_state rescuing.
Aug 15 02:13:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac89d155-924b-4293-97d6-ff13a3baf427]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqOGJcwW {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IqOGJcwW" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b7b417-7b80-4e27-937a-103d98fa9126]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IqOGJcwW'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcb883b-bc62-4e9b-ba3b-f0737af8d0f5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8296fe36-6d45-4190-947b-80237c80a756]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] HCTL ('38', '0', '0', 0) found on session 33 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbceb1f2-aa61-44e8-8ea5-69ad10f8e23c]: (4, ('0 0 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Searching for a device in session 33 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqOGJcwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '23734633765363738', 'path': '/dev/sdg'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734633765363738', 'path': '/dev/sdg'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1940753038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1940753038',id=30,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-1mrd2u0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:12:27Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=d5b2095f-df4e-4420-9dca-4552b10e3f3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "vif_mac": "fa:16:3e:25:46:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "vif_mac": "fa:16:3e:25:46:79"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:46:79,bridge_name='br-int',has_traffic_filtering=True,id=c423ec03-ba94-4691-bcc1-b7354e3b1a80,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc423ec03-ba') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.objects.instance [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'pci_devices' on Instance uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:13:47 user nova-compute[73121]:   <uuid>d5b2095f-df4e-4420-9dca-4552b10e3f3e</uuid>
Aug 15 02:13:47 user nova-compute[73121]:   <name>instance-0000001e</name>
Aug 15 02:13:47 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:13:47 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:13:47 user nova-compute[73121]:   <metadata>
Aug 15 02:13:47 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:13:47 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:13:47 user nova-compute[73121]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1940753038</nova:name>
Aug 15 02:13:47 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:13:47</nova:creationTime>
Aug 15 02:13:47 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:13:47 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:13:47 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:13:47 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:13:47 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:13:47 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:13:47 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:13:47 user nova-compute[73121]:       <nova:owner>
Aug 15 02:13:47 user nova-compute[73121]:         <nova:user uuid="4d8ef0b0581e4a10b066c15119bafde1">tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member</nova:user>
Aug 15 02:13:47 user nova-compute[73121]:         <nova:project uuid="ea879c6a9d1f4d58998e077524a07225">tempest-ServerBootFromVolumeStableRescueTest-893410799</nova:project>
Aug 15 02:13:47 user nova-compute[73121]:       </nova:owner>
Aug 15 02:13:47 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:13:47 user nova-compute[73121]:       <nova:ports>
Aug 15 02:13:47 user nova-compute[73121]:         <nova:port uuid="c423ec03-ba94-4691-bcc1-b7354e3b1a80">
Aug 15 02:13:47 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:13:47 user nova-compute[73121]:         </nova:port>
Aug 15 02:13:47 user nova-compute[73121]:       </nova:ports>
Aug 15 02:13:47 user nova-compute[73121]:     </nova:instance>
Aug 15 02:13:47 user nova-compute[73121]:   </metadata>
Aug 15 02:13:47 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:13:47 user nova-compute[73121]:     <system>
Aug 15 02:13:47 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:13:47 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:13:47 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:13:47 user nova-compute[73121]:       <entry name="serial">d5b2095f-df4e-4420-9dca-4552b10e3f3e</entry>
Aug 15 02:13:47 user nova-compute[73121]:       <entry name="uuid">d5b2095f-df4e-4420-9dca-4552b10e3f3e</entry>
Aug 15 02:13:47 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:13:47 user nova-compute[73121]:     </system>
Aug 15 02:13:47 user nova-compute[73121]:   </sysinfo>
Aug 15 02:13:47 user nova-compute[73121]:   <os>
Aug 15 02:13:47 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:13:47 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:13:47 user nova-compute[73121]:   </os>
Aug 15 02:13:47 user nova-compute[73121]:   <features>
Aug 15 02:13:47 user nova-compute[73121]:     <acpi/>
Aug 15 02:13:47 user nova-compute[73121]:     <apic/>
Aug 15 02:13:47 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:13:47 user nova-compute[73121]:   </features>
Aug 15 02:13:47 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:13:47 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:13:47 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:13:47 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:13:47 user nova-compute[73121]:   </clock>
Aug 15 02:13:47 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:13:47 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:13:47 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:13:47 user nova-compute[73121]:   </cpu>
Aug 15 02:13:47 user nova-compute[73121]:   <devices>
Aug 15 02:13:47 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:13:47 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:47 user nova-compute[73121]:       <source dev="/dev/sdg"/>
Aug 15 02:13:47 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:13:47 user nova-compute[73121]:       <serial>55e0936d-0dff-4421-a3a9-dd2194e9d086</serial>
Aug 15 02:13:47 user nova-compute[73121]:     </disk>
Aug 15 02:13:47 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:13:47 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:13:47 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue"/>
Aug 15 02:13:47 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:13:47 user nova-compute[73121]:       <boot order="1"/>
Aug 15 02:13:47 user nova-compute[73121]:     </disk>
Aug 15 02:13:47 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:13:47 user nova-compute[73121]:       <mac address="fa:16:3e:25:46:79"/>
Aug 15 02:13:47 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:13:47 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:13:47 user nova-compute[73121]:       <target dev="tapc423ec03-ba"/>
Aug 15 02:13:47 user nova-compute[73121]:     </interface>
Aug 15 02:13:47 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:13:47 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/console.log" append="off"/>
Aug 15 02:13:47 user nova-compute[73121]:     </serial>
Aug 15 02:13:47 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:13:47 user nova-compute[73121]:     <video>
Aug 15 02:13:47 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:13:47 user nova-compute[73121]:     </video>
Aug 15 02:13:47 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:13:47 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:13:47 user nova-compute[73121]:     </rng>
Aug 15 02:13:47 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:13:47 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:13:47 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:13:47 user nova-compute[73121]:     </memballoon>
Aug 15 02:13:47 user nova-compute[73121]:   </devices>
Aug 15 02:13:47 user nova-compute[73121]: </domain>
Aug 15 02:13:47 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:13:47 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance destroyed successfully.
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] No VIF found with MAC fa:16:3e:25:46:79, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-3274f508-4c4a-4cd4-ac3c-9829dd532b31 req-aa13893b-5730-469c-bbc3-d8a3a676e31e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-3274f508-4c4a-4cd4-ac3c-9829dd532b31 req-aa13893b-5730-469c-bbc3-d8a3a676e31e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing instance network info cache due to event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3274f508-4c4a-4cd4-ac3c-9829dd532b31 req-aa13893b-5730-469c-bbc3-d8a3a676e31e service nova] Acquiring lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3274f508-4c4a-4cd4-ac3c-9829dd532b31 req-aa13893b-5730-469c-bbc3-d8a3a676e31e service nova] Acquired lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:13:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-3274f508-4c4a-4cd4-ac3c-9829dd532b31 req-aa13893b-5730-469c-bbc3-d8a3a676e31e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:13:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-3274f508-4c4a-4cd4-ac3c-9829dd532b31 req-aa13893b-5730-469c-bbc3-d8a3a676e31e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updated VIF entry in instance network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:13:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-3274f508-4c4a-4cd4-ac3c-9829dd532b31 req-aa13893b-5730-469c-bbc3-d8a3a676e31e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updating instance_info_cache with network_info: [{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3274f508-4c4a-4cd4-ac3c-9829dd532b31 req-aa13893b-5730-469c-bbc3-d8a3a676e31e service nova] Releasing lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:13:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-4c26f80e-cd33-4780-af7c-8540c442ae8e req-ec71d1ec-4413-4557-b4d9-ccc1bac8da2f service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4c26f80e-cd33-4780-af7c-8540c442ae8e req-ec71d1ec-4413-4557-b4d9-ccc1bac8da2f service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4c26f80e-cd33-4780-af7c-8540c442ae8e req-ec71d1ec-4413-4557-b4d9-ccc1bac8da2f service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4c26f80e-cd33-4780-af7c-8540c442ae8e req-ec71d1ec-4413-4557-b4d9-ccc1bac8da2f service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-4c26f80e-cd33-4780-af7c-8540c442ae8e req-ec71d1ec-4413-4557-b4d9-ccc1bac8da2f service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:49 user nova-compute[73121]: WARNING nova.compute.manager [req-4c26f80e-cd33-4780-af7c-8540c442ae8e req-ec71d1ec-4413-4557-b4d9-ccc1bac8da2f service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state active and task_state rescuing.
Aug 15 02:13:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-bf375803-793a-4d66-99e6-ed71c24f95bd req-d7287bbc-33ec-4ddf-b03b-78579ee00da2 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received event network-changed-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-bf375803-793a-4d66-99e6-ed71c24f95bd req-d7287bbc-33ec-4ddf-b03b-78579ee00da2 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Refreshing instance network info cache due to event network-changed-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bf375803-793a-4d66-99e6-ed71c24f95bd req-d7287bbc-33ec-4ddf-b03b-78579ee00da2 service nova] Acquiring lock "refresh_cache-421fb8ac-c579-469a-9dda-e6ea7e2f6b48" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bf375803-793a-4d66-99e6-ed71c24f95bd req-d7287bbc-33ec-4ddf-b03b-78579ee00da2 service nova] Acquired lock "refresh_cache-421fb8ac-c579-469a-9dda-e6ea7e2f6b48" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-bf375803-793a-4d66-99e6-ed71c24f95bd req-d7287bbc-33ec-4ddf-b03b-78579ee00da2 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Refreshing network info cache for port 51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-776edae2-2525-46ea-a1a6-c8b513e3c51d req-c8dee53d-a1c9-4600-a4d8-44f33d7778bb service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-776edae2-2525-46ea-a1a6-c8b513e3c51d req-c8dee53d-a1c9-4600-a4d8-44f33d7778bb service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-776edae2-2525-46ea-a1a6-c8b513e3c51d req-c8dee53d-a1c9-4600-a4d8-44f33d7778bb service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-776edae2-2525-46ea-a1a6-c8b513e3c51d req-c8dee53d-a1c9-4600-a4d8-44f33d7778bb service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-776edae2-2525-46ea-a1a6-c8b513e3c51d req-c8dee53d-a1c9-4600-a4d8-44f33d7778bb service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:51 user nova-compute[73121]: WARNING nova.compute.manager [req-776edae2-2525-46ea-a1a6-c8b513e3c51d req-c8dee53d-a1c9-4600-a4d8-44f33d7778bb service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state active and task_state rescuing.
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for d5b2095f-df4e-4420-9dca-4552b10e3f3e due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065632.0553243, d5b2095f-df4e-4420-9dca-4552b10e3f3e => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:13:52 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] VM Resumed (Lifecycle Event)
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-04ff2164-b8b5-4e70-8949-5fef37136fc5 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:13:52 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065632.0554585, d5b2095f-df4e-4420-9dca-4552b10e3f3e => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:13:52 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] VM Started (Lifecycle Event)
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-bf375803-793a-4d66-99e6-ed71c24f95bd req-d7287bbc-33ec-4ddf-b03b-78579ee00da2 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Updated VIF entry in instance network info cache for port 51b00c9c-5181-4b2d-ba59-24eb2a4eb11a. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:13:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-bf375803-793a-4d66-99e6-ed71c24f95bd req-d7287bbc-33ec-4ddf-b03b-78579ee00da2 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Updating instance_info_cache with network_info: [{"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bf375803-793a-4d66-99e6-ed71c24f95bd req-d7287bbc-33ec-4ddf-b03b-78579ee00da2 service nova] Releasing lock "refresh_cache-421fb8ac-c579-469a-9dda-e6ea7e2f6b48" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:13:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:54 user nova-compute[73121]: INFO nova.compute.manager [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Rebooting instance
Aug 15 02:13:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:13:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquired lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:13:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:13:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updating instance_info_cache with network_info: [{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:13:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Releasing lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:13:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-6ae2416b-ff7a-40e6-904c-682ccb3d4536 req-f303db9d-1bfa-405f-94ce-291c3b50f26e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-unplugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ae2416b-ff7a-40e6-904c-682ccb3d4536 req-f303db9d-1bfa-405f-94ce-291c3b50f26e service nova] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ae2416b-ff7a-40e6-904c-682ccb3d4536 req-f303db9d-1bfa-405f-94ce-291c3b50f26e service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ae2416b-ff7a-40e6-904c-682ccb3d4536 req-f303db9d-1bfa-405f-94ce-291c3b50f26e service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-6ae2416b-ff7a-40e6-904c-682ccb3d4536 req-f303db9d-1bfa-405f-94ce-291c3b50f26e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] No waiting events found dispatching network-vif-unplugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:55 user nova-compute[73121]: WARNING nova.compute.manager [req-6ae2416b-ff7a-40e6-904c-682ccb3d4536 req-f303db9d-1bfa-405f-94ce-291c3b50f26e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received unexpected event network-vif-unplugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b for instance with vm_state active and task_state reboot_started_hard.
Aug 15 02:13:55 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Instance destroyed successfully.
Aug 15 02:13:55 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'resources' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724694426',display_name='tempest-TestMinimumBasicScenario-server-724694426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724694426',id=29,image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCv5wrOyrsFzl86DFGNOG2qdwU+l5stRjEuUFkXpORmxvzfKrk++1H0yJTS3sm8eXOfrl9ikhygtF+mYZYN2XmCBxEnWJzDHLcDUktCk2f1cZunA4iBo3k4IL4842am+Nw==',key_name='tempest-TestMinimumBasicScenario-2078449806',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3c8eef30d43d98388840e389efc24',ramdisk_id='',reservation_id='r-26nhe67r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2011934660',owner_user_name='tempest-TestMinimumBasicScenario-2011934660-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:13:55Z,user_data=None,user_id='3992e0609efb4ad389253810ab9b0d33',uuid=bc351c09-798d-4048-b80f-0dbf85344edb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converting VIF {"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG os_vif [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc315ab1b-2e, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:55 user nova-compute[73121]: INFO os_vif [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e')
Aug 15 02:13:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdeowFiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:55 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:13:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07acf741-deb2-4e24-b7a7-aadd110ab046]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ab0c5d-3c2e-4a03-915e-68ab1e4b28b8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc64b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575'): ({'sde'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Removing single pathed devices sde {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fd5754-d583-446c-a110-98152fc05267]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4276ecdb-2354-421e-8835-bc43882d1635]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Flushing IO for device /dev/sde {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e3ce3d-256f-4dbf-ba40-41c48b8c2077]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45e5223-b22f-4d7a-9003-20f15721f5d9]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[10db2cc5-915a-4695-a091-1c4876d3039c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'flavor' on Instance uuid 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9689eaa-2608-42cb-82b5-69f1ff48dc53]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260]
Aug 15 02:13:56 user nova-compute[73121]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260] successful.
Aug 15 02:13:56 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f4bae-b045-402d-8b23-ba3784b179bb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] <== disconnect_volume: return (373ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Start _get_guest_xml network_info=[{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=93d97bf5-b392-4cc3-b28f-86cb5a52e660,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '93d97bf5-b392-4cc3-b28f-86cb5a52e660'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'a0535f39-d510-4517-9166-cde90d3a4fef', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdeowFiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'bc351c09-798d-4048-b80f-0dbf85344edb', 'attached_at': '', 'detached_at': '', 'volume_id': 'f7b28ba1-c5e0-47c2-9290-df72eb9b2575', 'serial': 'f7b28ba1-c5e0-47c2-9290-df72eb9b2575'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:13:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:13:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=93d97bf5-b392-4cc3-b28f-86cb5a52e660,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdeowFiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:56 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:56 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:13:56 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd839e-4261-4fbe-83aa-d03e09e50ab2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:13:56 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:56 user nova-compute[73121]: INFO nova.compute.manager [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Attaching volume ef05f657-2c45-41f6-98df-13e3655cbfd8 to /dev/vdb
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3795979-f66f-4e2d-a76d-5ff0f3d33bb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575] added
Aug 15 02:13:56 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece17c7a-2e31-4d36-8c3a-cee0b6133d12]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.utils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9d149e-ec70-44ce-abd2-9890fa531428]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdeowFiM {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d82583a-c4d1-4929-8ccd-57696f9c69d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xdeowFiM" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b306f0fa-fc9e-4386-bfab-7b54174406cd]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xdeowFiM'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6be54ca-186d-46e1-9323-64da9136e7c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c7454-3209-4c82-95ff-01a33898f90b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[df325a04-8a4c-40a4-acb6-bc04f398801d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[12200152-63c1-4525-8e1c-aae1c6c75530]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[38220b9c-b1d0-430a-b7da-f986b963a2eb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:13:56 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[da58c3f1-980e-4ccd-be0e-f09ce3ee7e9d]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.utils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Updating existing volume attachment record: 745ea079-4ff2-4322-a3e8-a6ad133a926a {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdef451-42bd-4485-b039-a37d859e206f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260]
Aug 15 02:13:56 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260] successful.
Aug 15 02:13:56 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb366de-db19-4f7c-bedd-7cd2d87abe65]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87c9cf2-c0ff-40ef-8cde-2adc8e624e94]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:13:56 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a62cd40-5d92-42cd-8400-0443febf171a]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:13:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdeowFiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-57a323ee-4264-4eed-a86d-48164a5fc26d req-03e2f4dd-eaea-4d0a-a33e-3c4184421edb service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-57a323ee-4264-4eed-a86d-48164a5fc26d req-03e2f4dd-eaea-4d0a-a33e-3c4184421edb service nova] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-57a323ee-4264-4eed-a86d-48164a5fc26d req-03e2f4dd-eaea-4d0a-a33e-3c4184421edb service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-57a323ee-4264-4eed-a86d-48164a5fc26d req-03e2f4dd-eaea-4d0a-a33e-3c4184421edb service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-57a323ee-4264-4eed-a86d-48164a5fc26d req-03e2f4dd-eaea-4d0a-a33e-3c4184421edb service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] No waiting events found dispatching network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:13:57 user nova-compute[73121]: WARNING nova.compute.manager [req-57a323ee-4264-4eed-a86d-48164a5fc26d req-03e2f4dd-eaea-4d0a-a33e-3c4184421edb service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received unexpected event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b for instance with vm_state active and task_state reboot_started_hard.
Aug 15 02:13:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.444s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '23363643034376132', 'path': '/dev/sde'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363643034376132', 'path': '/dev/sde'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724694426',display_name='tempest-TestMinimumBasicScenario-server-724694426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724694426',id=29,image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCv5wrOyrsFzl86DFGNOG2qdwU+l5stRjEuUFkXpORmxvzfKrk++1H0yJTS3sm8eXOfrl9ikhygtF+mYZYN2XmCBxEnWJzDHLcDUktCk2f1cZunA4iBo3k4IL4842am+Nw==',key_name='tempest-TestMinimumBasicScenario-2078449806',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3c8eef30d43d98388840e389efc24',ramdisk_id='',reservation_id='r-26nhe67r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2011934660',owner_user_name='tempest-TestMinimumBasicScenario-2011934660-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:13:55Z,user_data=None,user_id='3992e0609efb4ad389253810ab9b0d33',uuid=bc351c09-798d-4048-b80f-0dbf85344edb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converting VIF {"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'pci_devices' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:13:57 user nova-compute[73121]:   <uuid>bc351c09-798d-4048-b80f-0dbf85344edb</uuid>
Aug 15 02:13:57 user nova-compute[73121]:   <name>instance-0000001d</name>
Aug 15 02:13:57 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:13:57 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:13:57 user nova-compute[73121]:   <metadata>
Aug 15 02:13:57 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:13:57 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:13:57 user nova-compute[73121]:       <nova:name>tempest-TestMinimumBasicScenario-server-724694426</nova:name>
Aug 15 02:13:57 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:13:56</nova:creationTime>
Aug 15 02:13:57 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:13:57 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:13:57 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:13:57 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:13:57 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:13:57 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:13:57 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:13:57 user nova-compute[73121]:       <nova:owner>
Aug 15 02:13:57 user nova-compute[73121]:         <nova:user uuid="3992e0609efb4ad389253810ab9b0d33">tempest-TestMinimumBasicScenario-2011934660-project-member</nova:user>
Aug 15 02:13:57 user nova-compute[73121]:         <nova:project uuid="b1b3c8eef30d43d98388840e389efc24">tempest-TestMinimumBasicScenario-2011934660</nova:project>
Aug 15 02:13:57 user nova-compute[73121]:       </nova:owner>
Aug 15 02:13:57 user nova-compute[73121]:       <nova:root type="image" uuid="93d97bf5-b392-4cc3-b28f-86cb5a52e660"/>
Aug 15 02:13:57 user nova-compute[73121]:       <nova:ports>
Aug 15 02:13:57 user nova-compute[73121]:         <nova:port uuid="c315ab1b-2e05-4e8b-a995-849f3cb9249b">
Aug 15 02:13:57 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:13:57 user nova-compute[73121]:         </nova:port>
Aug 15 02:13:57 user nova-compute[73121]:       </nova:ports>
Aug 15 02:13:57 user nova-compute[73121]:     </nova:instance>
Aug 15 02:13:57 user nova-compute[73121]:   </metadata>
Aug 15 02:13:57 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:13:57 user nova-compute[73121]:     <system>
Aug 15 02:13:57 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:13:57 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:13:57 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:13:57 user nova-compute[73121]:       <entry name="serial">bc351c09-798d-4048-b80f-0dbf85344edb</entry>
Aug 15 02:13:57 user nova-compute[73121]:       <entry name="uuid">bc351c09-798d-4048-b80f-0dbf85344edb</entry>
Aug 15 02:13:57 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:13:57 user nova-compute[73121]:     </system>
Aug 15 02:13:57 user nova-compute[73121]:   </sysinfo>
Aug 15 02:13:57 user nova-compute[73121]:   <os>
Aug 15 02:13:57 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:13:57 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:13:57 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:13:57 user nova-compute[73121]:   </os>
Aug 15 02:13:57 user nova-compute[73121]:   <features>
Aug 15 02:13:57 user nova-compute[73121]:     <acpi/>
Aug 15 02:13:57 user nova-compute[73121]:     <apic/>
Aug 15 02:13:57 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:13:57 user nova-compute[73121]:   </features>
Aug 15 02:13:57 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:13:57 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:13:57 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:13:57 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:13:57 user nova-compute[73121]:   </clock>
Aug 15 02:13:57 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:13:57 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:13:57 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:13:57 user nova-compute[73121]:   </cpu>
Aug 15 02:13:57 user nova-compute[73121]:   <devices>
Aug 15 02:13:57 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:13:57 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:13:57 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk"/>
Aug 15 02:13:57 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:13:57 user nova-compute[73121]:     </disk>
Aug 15 02:13:57 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:13:57 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:13:57 user nova-compute[73121]:       <source dev="/dev/sde"/>
Aug 15 02:13:57 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:13:57 user nova-compute[73121]:       <serial>f7b28ba1-c5e0-47c2-9290-df72eb9b2575</serial>
Aug 15 02:13:57 user nova-compute[73121]:     </disk>
Aug 15 02:13:57 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:13:57 user nova-compute[73121]:       <mac address="fa:16:3e:cb:f3:fa"/>
Aug 15 02:13:57 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:13:57 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:13:57 user nova-compute[73121]:       <target dev="tapc315ab1b-2e"/>
Aug 15 02:13:57 user nova-compute[73121]:     </interface>
Aug 15 02:13:57 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:13:57 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/console.log" append="off"/>
Aug 15 02:13:57 user nova-compute[73121]:     </serial>
Aug 15 02:13:57 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:13:57 user nova-compute[73121]:     <video>
Aug 15 02:13:57 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:13:57 user nova-compute[73121]:     </video>
Aug 15 02:13:57 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:13:57 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:13:57 user nova-compute[73121]:     </rng>
Aug 15 02:13:57 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:13:57 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:13:57 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:13:57 user nova-compute[73121]:     </memballoon>
Aug 15 02:13:57 user nova-compute[73121]:   </devices>
Aug 15 02:13:57 user nova-compute[73121]: </domain>
Aug 15 02:13:57 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:13:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'trusted_certs' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Cannot resize image /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'migration_context' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724694426',display_name='tempest-TestMinimumBasicScenario-server-724694426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724694426',id=29,image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCv5wrOyrsFzl86DFGNOG2qdwU+l5stRjEuUFkXpORmxvzfKrk++1H0yJTS3sm8eXOfrl9ikhygtF+mYZYN2XmCBxEnWJzDHLcDUktCk2f1cZunA4iBo3k4IL4842am+Nw==',key_name='tempest-TestMinimumBasicScenario-2078449806',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3c8eef30d43d98388840e389efc24',ramdisk_id='',reservation_id='r-26nhe67r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2011934660',owner_user_name='tempest-TestMinimumBasicScenario-2011934660-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:13:55Z,user_data=None,user_id='3992e0609efb4ad389253810ab9b0d33',uuid=bc351c09-798d-4048-b80f-0dbf85344edb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converting VIF {"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG os_vif [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc315ab1b-2e, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc315ab1b-2e, col_values=(('external_ids', {'iface-id': 'c315ab1b-2e05-4e8b-a995-849f3cb9249b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:f3:fa', 'vm-uuid': 'bc351c09-798d-4048-b80f-0dbf85344edb'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:13:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:13:58 user nova-compute[73121]: INFO os_vif [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e')
Aug 15 02:14:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-53a32bac-4446-4e6c-895d-5c899900c856 req-73533399-7a80-4247-95ee-bd3ff472e09d service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:14:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-53a32bac-4446-4e6c-895d-5c899900c856 req-73533399-7a80-4247-95ee-bd3ff472e09d service nova] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-53a32bac-4446-4e6c-895d-5c899900c856 req-73533399-7a80-4247-95ee-bd3ff472e09d service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-53a32bac-4446-4e6c-895d-5c899900c856 req-73533399-7a80-4247-95ee-bd3ff472e09d service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-53a32bac-4446-4e6c-895d-5c899900c856 req-73533399-7a80-4247-95ee-bd3ff472e09d service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] No waiting events found dispatching network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:14:00 user nova-compute[73121]: WARNING nova.compute.manager [req-53a32bac-4446-4e6c-895d-5c899900c856 req-73533399-7a80-4247-95ee-bd3ff472e09d service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received unexpected event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b for instance with vm_state active and task_state reboot_started_hard.
Aug 15 02:14:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.compute.manager [req-5b353ae5-0543-49a0-a250-5a802861ac87 req-8e28dcd9-994c-4550-89fe-0781bb0b0d2f service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5b353ae5-0543-49a0-a250-5a802861ac87 req-8e28dcd9-994c-4550-89fe-0781bb0b0d2f service nova] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5b353ae5-0543-49a0-a250-5a802861ac87 req-8e28dcd9-994c-4550-89fe-0781bb0b0d2f service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5b353ae5-0543-49a0-a250-5a802861ac87 req-8e28dcd9-994c-4550-89fe-0781bb0b0d2f service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.compute.manager [req-5b353ae5-0543-49a0-a250-5a802861ac87 req-8e28dcd9-994c-4550-89fe-0781bb0b0d2f service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] No waiting events found dispatching network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:14:02 user nova-compute[73121]: WARNING nova.compute.manager [req-5b353ae5-0543-49a0-a250-5a802861ac87 req-8e28dcd9-994c-4550-89fe-0781bb0b0d2f service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received unexpected event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b for instance with vm_state active and task_state reboot_started_hard.
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for bc351c09-798d-4048-b80f-0dbf85344edb due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065642.621513, bc351c09-798d-4048-b80f-0dbf85344edb => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:14:02 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] VM Resumed (Lifecycle Event)
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:14:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Instance rebooted successfully.
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:14:02 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065642.6245806, bc351c09-798d-4048-b80f-0dbf85344edb => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:14:02 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] VM Started (Lifecycle Event)
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:14:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2924a753-b20e-44d6-9804-1fc9987a8450 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.446s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:05 user nova-compute[73121]: INFO nova.compute.manager [None req-4136d32c-492f-43f8-8b02-51c148afb2f5 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Unrescuing
Aug 15 02:14:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4136d32c-492f-43f8-8b02-51c148afb2f5 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:14:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4136d32c-492f-43f8-8b02-51c148afb2f5 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquired lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:14:05 user nova-compute[73121]: DEBUG nova.network.neutron [None req-4136d32c-492f-43f8-8b02-51c148afb2f5 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG nova.network.neutron [None req-4136d32c-492f-43f8-8b02-51c148afb2f5 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating instance_info_cache with network_info: [{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4136d32c-492f-43f8-8b02-51c148afb2f5 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Releasing lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG nova.objects.instance [None req-4136d32c-492f-43f8-8b02-51c148afb2f5 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'flavor' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-8b5d76c0-8d2f-474e-a75d-7c5fb2518e70 req-9f694208-26a6-4fe9-9cf2-722751f4e13e service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-unplugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8b5d76c0-8d2f-474e-a75d-7c5fb2518e70 req-9f694208-26a6-4fe9-9cf2-722751f4e13e service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8b5d76c0-8d2f-474e-a75d-7c5fb2518e70 req-9f694208-26a6-4fe9-9cf2-722751f4e13e service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8b5d76c0-8d2f-474e-a75d-7c5fb2518e70 req-9f694208-26a6-4fe9-9cf2-722751f4e13e service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-8b5d76c0-8d2f-474e-a75d-7c5fb2518e70 req-9f694208-26a6-4fe9-9cf2-722751f4e13e service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-unplugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:14:06 user nova-compute[73121]: WARNING nova.compute.manager [req-8b5d76c0-8d2f-474e-a75d-7c5fb2518e70 req-9f694208-26a6-4fe9-9cf2-722751f4e13e service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-unplugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:14:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-d52eab1d-93ce-4d98-bec8-389f9efd2402 req-965ff3ac-a27a-4227-ad9c-8a312851b92a service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-changed-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-d52eab1d-93ce-4d98-bec8-389f9efd2402 req-965ff3ac-a27a-4227-ad9c-8a312851b92a service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Refreshing instance network info cache due to event network-changed-eeb90096-6720-4d4b-954c-f03f3eeba489. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d52eab1d-93ce-4d98-bec8-389f9efd2402 req-965ff3ac-a27a-4227-ad9c-8a312851b92a service nova] Acquiring lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d52eab1d-93ce-4d98-bec8-389f9efd2402 req-965ff3ac-a27a-4227-ad9c-8a312851b92a service nova] Acquired lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG nova.network.neutron [req-d52eab1d-93ce-4d98-bec8-389f9efd2402 req-965ff3ac-a27a-4227-ad9c-8a312851b92a service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Refreshing network info cache for port eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:14:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Instance destroyed successfully.
Aug 15 02:14:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaHfGbsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:14:07 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:14:07 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:14:07 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddd8313-e6a7-46a2-9dd2-7801e0ea1f66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:14:07 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cea77ad-9a68-4a23-9fc2-e97aee0c5390]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8] added
Aug 15 02:14:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[87915ec3-3377-4905-8ce8-c5d9ef68362d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5390f8c-2116-4552-9b2d-7c1553beb4d7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaHfGbsM {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IaHfGbsM" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[77311486-a40c-4cc6-9d1d-a9da026fb892]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IaHfGbsM'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067f454-f210-4177-9b46-08faf130b7a1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6a5dee-2aec-4b0e-8b94-038c4ceb4d51]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[417f579c-059f-4a7c-b27e-096de829d082]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8, portal: 172.16.0.220,3260]
Aug 15 02:14:07 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8, portal: 172.16.0.220,3260] successful.
Aug 15 02:14:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[81078d29-24d7-447c-b70b-f6f0cb86a513]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01ac30c-99a8-4bd8-8474-57b21c0b5390]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 (non-flash)
Aug 15 02:14:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] HCTL ('39', '-', '-', 0) found on session 40 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:14:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d01b76c-b4af-4047-bacd-35c6ab41cc22]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:08 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:14:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaHfGbsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:14:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-d52eab1d-93ce-4d98-bec8-389f9efd2402 req-965ff3ac-a27a-4227-ad9c-8a312851b92a service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updated VIF entry in instance network info cache for port eeb90096-6720-4d4b-954c-f03f3eeba489. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:14:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-d52eab1d-93ce-4d98-bec8-389f9efd2402 req-965ff3ac-a27a-4227-ad9c-8a312851b92a service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating instance_info_cache with network_info: [{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:14:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d52eab1d-93ce-4d98-bec8-389f9efd2402 req-965ff3ac-a27a-4227-ad9c-8a312851b92a service nova] Releasing lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:14:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-027ef530-2d7d-497a-8150-4155e5d31821 req-92dc403f-47ab-46e6-81a0-88d10e8ac9d6 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-027ef530-2d7d-497a-8150-4155e5d31821 req-92dc403f-47ab-46e6-81a0-88d10e8ac9d6 service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-027ef530-2d7d-497a-8150-4155e5d31821 req-92dc403f-47ab-46e6-81a0-88d10e8ac9d6 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-027ef530-2d7d-497a-8150-4155e5d31821 req-92dc403f-47ab-46e6-81a0-88d10e8ac9d6 service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-027ef530-2d7d-497a-8150-4155e5d31821 req-92dc403f-47ab-46e6-81a0-88d10e8ac9d6 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:14:09 user nova-compute[73121]: WARNING nova.compute.manager [req-027ef530-2d7d-497a-8150-4155e5d31821 req-92dc403f-47ab-46e6-81a0-88d10e8ac9d6 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:14:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] <== connect_volume: return (1450ms) {'type': 'block', 'scsi_wwn': '23266323362373162', 'path': '/dev/sdh'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266323362373162', 'path': '/dev/sdh'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'flavor' on Instance uuid 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:14:09 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:09 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:14:09 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:09 user nova-compute[73121]:   <serial>ef05f657-2c45-41f6-98df-13e3655cbfd8</serial>
Aug 15 02:14:09 user nova-compute[73121]: </disk>
Aug 15 02:14:09 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-143a08b8-5225-4919-ab15-868c075b3310 req-4db7e98a-4aa4-402e-9621-8c19fde40dd2 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-changed-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-143a08b8-5225-4919-ab15-868c075b3310 req-4db7e98a-4aa4-402e-9621-8c19fde40dd2 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Refreshing instance network info cache due to event network-changed-eeb90096-6720-4d4b-954c-f03f3eeba489. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-143a08b8-5225-4919-ab15-868c075b3310 req-4db7e98a-4aa4-402e-9621-8c19fde40dd2 service nova] Acquiring lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-143a08b8-5225-4919-ab15-868c075b3310 req-4db7e98a-4aa4-402e-9621-8c19fde40dd2 service nova] Acquired lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-143a08b8-5225-4919-ab15-868c075b3310 req-4db7e98a-4aa4-402e-9621-8c19fde40dd2 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Refreshing network info cache for port eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No VIF found with MAC fa:16:3e:e1:97:5c, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:14:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-47a25cbe-4b63-428a-85de-3f9f9ee849a0 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.542s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:10 user nova-compute[73121]: DEBUG nova.network.neutron [req-143a08b8-5225-4919-ab15-868c075b3310 req-4db7e98a-4aa4-402e-9621-8c19fde40dd2 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updated VIF entry in instance network info cache for port eeb90096-6720-4d4b-954c-f03f3eeba489. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:14:10 user nova-compute[73121]: DEBUG nova.network.neutron [req-143a08b8-5225-4919-ab15-868c075b3310 req-4db7e98a-4aa4-402e-9621-8c19fde40dd2 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating instance_info_cache with network_info: [{"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:14:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-143a08b8-5225-4919-ab15-868c075b3310 req-4db7e98a-4aa4-402e-9621-8c19fde40dd2 service nova] Releasing lock "refresh_cache-012c74eb-e477-42dc-a04e-908b51e82de1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:14:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:10 user nova-compute[73121]: INFO nova.compute.manager [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Detaching volume ef05f657-2c45-41f6-98df-13e3655cbfd8
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:14:11 user nova-compute[73121]: WARNING nova.compute.manager [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:14:11 user nova-compute[73121]: WARNING nova.compute.manager [req-239f6b4c-7b1c-4135-b544-a3634774677d req-3a9dfb10-c841-4f4f-85e6-580675e09e1f service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:14:11 user nova-compute[73121]: INFO nova.virt.block_device [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Attempting to driver detach volume ef05f657-2c45-41f6-98df-13e3655cbfd8 from mountpoint /dev/vdb
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Attempting to detach device vdb from instance 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:14:11 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:11 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:14:11 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:11 user nova-compute[73121]:   <serial>ef05f657-2c45-41f6-98df-13e3655cbfd8</serial>
Aug 15 02:14:11 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:14:11 user nova-compute[73121]: </disk>
Aug 15 02:14:11 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:14:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully detached device vdb from instance 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 from the persistent domain config.
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:14:11 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:11 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:14:11 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:11 user nova-compute[73121]:   <serial>ef05f657-2c45-41f6-98df-13e3655cbfd8</serial>
Aug 15 02:14:11 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:14:11 user nova-compute[73121]: </disk>
Aug 15 02:14:11 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065651.6117635, 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:14:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully detached device vdb from instance 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 from the live domain config.
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IaHfGbsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:14:11 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a59b3ed-2871-4f41-a450-1f0d62d2b21b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb81373-94a0-495d-8a8d-b67e2f385409]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 (non-flash)
Aug 15 02:14:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e20630e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8'): ({'sdh'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Removing single pathed devices sdh {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3126f4-e2db-4481-8671-d60b237a9147]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d1e80d-7a9b-434e-bb3e-51e4e4f5bf1c]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flushing IO for device /dev/sdh {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff71bd58-00b2-4c69-8b19-de70fcc75444]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f509ea6f-fbfb-46e6-b8b2-8dcfc9be2859]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3d4a6f-aa61-4bbe-848e-c290915dac3b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for 012c74eb-e477-42dc-a04e-908b51e82de1 due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065651.8513148, 012c74eb-e477-42dc-a04e-908b51e82de1 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:14:11 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] VM Resumed (Lifecycle Event)
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-4136d32c-492f-43f8-8b02-51c148afb2f5 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7ea755-5d79-439d-88d4-f2c9c1806773]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8, portal: 172.16.0.220,3260]
Aug 15 02:14:11 user nova-compute[73121]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8, portal: 172.16.0.220,3260] successful.
Aug 15 02:14:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065651.8522735, 012c74eb-e477-42dc-a04e-908b51e82de1 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:14:11 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] VM Started (Lifecycle Event)
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef05f657-2c45-41f6-98df-13e3655cbfd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[40608557-ea64-4adf-9821-d0fdb6a82300]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] <== disconnect_volume: return (344ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:14:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:14:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:12 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'flavor' on Instance uuid 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:14:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2dc15663-e405-44bb-916d-bea897c88551 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.936s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:15 user nova-compute[73121]: INFO nova.compute.manager [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Detaching volume bd74c2bc-2cc4-44dd-8da3-e578c6de9791
Aug 15 02:14:15 user nova-compute[73121]: INFO nova.virt.block_device [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Attempting to driver detach volume bd74c2bc-2cc4-44dd-8da3-e578c6de9791 from mountpoint /dev/vdb
Aug 15 02:14:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Attempting to detach device vdb from instance be6f8247-2be1-4add-92e9-54e4bef5c44c from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:14:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:14:15 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:15 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:14:15 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:15 user nova-compute[73121]:   <serial>bd74c2bc-2cc4-44dd-8da3-e578c6de9791</serial>
Aug 15 02:14:15 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 02:14:15 user nova-compute[73121]: </disk>
Aug 15 02:14:15 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:14:15 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully detached device vdb from instance be6f8247-2be1-4add-92e9-54e4bef5c44c from the persistent domain config.
Aug 15 02:14:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be6f8247-2be1-4add-92e9-54e4bef5c44c from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:14:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:14:15 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:15 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:14:15 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:15 user nova-compute[73121]:   <serial>bd74c2bc-2cc4-44dd-8da3-e578c6de9791</serial>
Aug 15 02:14:15 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 02:14:15 user nova-compute[73121]: </disk>
Aug 15 02:14:15 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065656.4480457, be6f8247-2be1-4add-92e9-54e4bef5c44c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:14:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully detached device vdb from instance be6f8247-2be1-4add-92e9-54e4bef5c44c from the live domain config.
Aug 15 02:14:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWFHTMVs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:14:16 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3755b4dd-8cc8-4c3f-9334-0fb247a4145e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d41436-d327-462f-bfd0-5dc9c0d335ba]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e319cb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791'): ({'sdd'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Removing single pathed devices sdd {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e80b3d-d46d-44a0-bde5-366498309930]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaa4c8a-a7ab-4464-8ba0-30682fdc9c5c]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flushing IO for device /dev/sdd {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdf4e0f-861b-46aa-ba20-e5a98bdb0613]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e2d10c-7b0e-4ae4-823e-9b62fe6b0bd1]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69c50be-a97e-48c0-bf9d-4c7d4f55d0fc]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abdcf88-9331-4bf0-81af-81d4de14e8a4]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260]
Aug 15 02:14:16 user nova-compute[73121]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791, portal: 172.16.0.220,3260] successful.
Aug 15 02:14:16 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bd74c2bc-2cc4-44dd-8da3-e578c6de9791 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6539612f-9001-4536-84ad-23b77d00829d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== disconnect_volume: return (321ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:14:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:14:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:17 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'flavor' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:14:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d4ed31fe-ea0e-44bf-b82d-494253715caf tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.985s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updating instance_info_cache with network_info: [{"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:14:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:32 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:14:32 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7042MB free_disk=25.053028106689453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 012c74eb-e477-42dc-a04e-908b51e82de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7950f28-0893-49de-a560-bbc0791492b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance be6f8247-2be1-4add-92e9-54e4bef5c44c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance afb831b1-b2b9-4771-a759-47fbaa2a0382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 00d2c851-39b9-40cb-8bac-785c954800cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance bc351c09-798d-4048-b80f-0dbf85344edb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d5b2095f-df4e-4420-9dca-4552b10e3f3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1c5e851-4933-4db6-b7d5-ec2b417ec259 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:14:32 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.617s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:33 user nova-compute[73121]: INFO nova.compute.manager [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attaching volume fed27f0e-e0bc-435a-ace2-b3d325642a91 to /dev/vdb
Aug 15 02:14:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13f8b0a-54c5-442b-9c2f-bdd0f95ad4ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84562be-3686-452a-997f-8cae227d815c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1cdf1f-6873-45af-8136-24eba71b7844]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ffdac7-118f-4f5e-8ee3-888e979cb669]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:14:34 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:14:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3682eb74-60aa-4a43-8d5a-1b90587d0cb3]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:14:34 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updating existing volume attachment record: 5c66b83b-caaf-418e-96c2-8e430d8dd33b {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:14:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:14:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:39 user nova-compute[73121]: INFO nova.compute.manager [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Detaching volume c3549704-2d58-4476-88a0-72b25fd7ddc7
Aug 15 02:14:39 user nova-compute[73121]: INFO nova.virt.block_device [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Attempting to driver detach volume c3549704-2d58-4476-88a0-72b25fd7ddc7 from mountpoint /dev/vdb
Aug 15 02:14:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Attempting to detach device vdb from instance 012c74eb-e477-42dc-a04e-908b51e82de1 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:14:39 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:39 user nova-compute[73121]:   <source dev="/dev/sdf"/>
Aug 15 02:14:39 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:39 user nova-compute[73121]:   <serial>c3549704-2d58-4476-88a0-72b25fd7ddc7</serial>
Aug 15 02:14:39 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:14:39 user nova-compute[73121]: </disk>
Aug 15 02:14:39 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:14:39 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Successfully detached device vdb from instance 012c74eb-e477-42dc-a04e-908b51e82de1 from the persistent domain config.
Aug 15 02:14:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 012c74eb-e477-42dc-a04e-908b51e82de1 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:14:39 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:39 user nova-compute[73121]:   <source dev="/dev/sdf"/>
Aug 15 02:14:39 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:39 user nova-compute[73121]:   <serial>c3549704-2d58-4476-88a0-72b25fd7ddc7</serial>
Aug 15 02:14:39 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:14:39 user nova-compute[73121]: </disk>
Aug 15 02:14:39 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065679.879159, 012c74eb-e477-42dc-a04e-908b51e82de1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:14:39 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Successfully detached device vdb from instance 012c74eb-e477-42dc-a04e-908b51e82de1 from the live domain config.
Aug 15 02:14:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NaoBLYvF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:14:39 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:14:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[348bc7ae-7958-43d9-9b60-774a327dfa29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b844d667-b7ed-4554-a70d-bf5546674de2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:39 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc649ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7'): ({'sdf'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Removing single pathed devices sdf {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[307c24a5-d4e5-4894-9452-36710f8a942c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adfc157-5b45-46ee-807a-180b8fb2ddcb]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Flushing IO for device /dev/sdf {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be6b482-4e84-44d8-aaa2-816f51bcbd8f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cff0f85-09fd-40c8-a8c3-7681e51bda15]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] SCSI volumes sdf have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d04b74-80ff-43b1-ab32-d5cba5608e8f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[97616f5f-0fbc-4253-ba09-1de04f60e1b7]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7, portal: 172.16.0.220,3260]
Aug 15 02:14:40 user nova-compute[73121]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7, portal: 172.16.0.220,3260] successful.
Aug 15 02:14:40 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3549704-2d58-4476-88a0-72b25fd7ddc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1292daea-3644-4d6e-9ed0-3126e1d5b61b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] <== disconnect_volume: return (333ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:14:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:14:41 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'flavor' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:14:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ed6c19bd-e475-4487-9328-1a5e80437f23 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.836s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyKpMNao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:14:43 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:14:43 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:14:43 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4da644b-5b79-47ad-bf3f-6aa84f794711]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:14:43 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3596f245-1b85-4f47-a5cc-dcb4d2106926]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91] added
Aug 15 02:14:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1313ca1a-40f0-44cf-8737-3132d5aca2ee]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[baddc3cb-69a1-4536-a915-96b9ea25bd9b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyKpMNao {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyKpMNao" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5e071c-9d02-4ceb-9c6a-342ee757878b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tyKpMNao'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d9178a-b927-49cd-a846-68cc781516d9]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[331615b5-d2e6-46fe-8b72-5207e62fbfa0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec063e01-b802-448a-ab07-e064ced5f3fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91, portal: 172.16.0.220,3260]
Aug 15 02:14:44 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91, portal: 172.16.0.220,3260] successful.
Aug 15 02:14:44 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[66babeae-332e-47d9-a7a2-81240b3b8143]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[459ac8a2-ac0c-4047-91fb-45b6773c569b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 (non-flash)
Aug 15 02:14:44 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76f8620-02c6-4ef9-bf21-f84d2bb3a82f]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:44 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyKpMNao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23033386533323835', 'path': '/dev/sdd'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033386533323835', 'path': '/dev/sdd'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:14:45 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:45 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:14:45 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:45 user nova-compute[73121]:   <serial>fed27f0e-e0bc-435a-ace2-b3d325642a91</serial>
Aug 15 02:14:45 user nova-compute[73121]: </disk>
Aug 15 02:14:45 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No VIF found with MAC fa:16:3e:1c:c1:76, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:14:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8fa2057-63ff-42d5-afeb-c29450d5fdcd tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.986s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:14:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:14:48 user nova-compute[73121]: INFO nova.compute.manager [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Detaching volume fed27f0e-e0bc-435a-ace2-b3d325642a91
Aug 15 02:14:48 user nova-compute[73121]: INFO nova.virt.block_device [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attempting to driver detach volume fed27f0e-e0bc-435a-ace2-b3d325642a91 from mountpoint /dev/vdb
Aug 15 02:14:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Attempting to detach device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:14:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:14:48 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:48 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:14:48 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:48 user nova-compute[73121]:   <serial>fed27f0e-e0bc-435a-ace2-b3d325642a91</serial>
Aug 15 02:14:48 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:14:48 user nova-compute[73121]: </disk>
Aug 15 02:14:48 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:14:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully detached device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the persistent domain config.
Aug 15 02:14:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:14:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:14:48 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:14:48 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:14:48 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:14:48 user nova-compute[73121]:   <serial>fed27f0e-e0bc-435a-ace2-b3d325642a91</serial>
Aug 15 02:14:48 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:14:48 user nova-compute[73121]: </disk>
Aug 15 02:14:48 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:14:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065689.2229035, afb831b1-b2b9-4771-a759-47fbaa2a0382 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:14:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully detached device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the live domain config.
Aug 15 02:14:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyKpMNao', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:14:49 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9246d47-8025-4f5c-97d5-961ec429cdbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2c84f8-8d93-4da4-9049-9911ba6e1e4d]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 (non-flash)
Aug 15 02:14:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc733d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91'): ({'sdd'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Removing single pathed devices sdd {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cc0f44-f097-4ea2-af00-72adb40259ad]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f64f8fb-b22f-4c91-b2e2-dbedf03ab7f9]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Flushing IO for device /dev/sdd {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[75758587-da8d-4648-9eb8-1ee55c98eec0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0447ff6a-1770-4c13-89b0-2cb4c130bbc3]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[962166c5-7a3c-4acb-ade7-09b807c0e893]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a00b9a0-4a2e-4806-80c9-6d413e21aa2c]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91, portal: 172.16.0.220,3260]
Aug 15 02:14:49 user nova-compute[73121]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91, portal: 172.16.0.220,3260] successful.
Aug 15 02:14:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fed27f0e-e0bc-435a-ace2-b3d325642a91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[91eed749-8fc0-415a-9c18-3c9747a49138]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== disconnect_volume: return (323ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:14:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:14:50 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:14:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e79e9f42-66d6-413c-b8de-1b122240543d tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.977s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:14:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:14:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:01 user nova-compute[73121]: INFO nova.compute.manager [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Terminating instance
Aug 15 02:15:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-6f970122-44a9-4b85-9b75-5275364c3f24 req-aff86924-4603-4d4a-8cd7-3387a34d7f24 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received event network-vif-unplugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6f970122-44a9-4b85-9b75-5275364c3f24 req-aff86924-4603-4d4a-8cd7-3387a34d7f24 service nova] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6f970122-44a9-4b85-9b75-5275364c3f24 req-aff86924-4603-4d4a-8cd7-3387a34d7f24 service nova] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6f970122-44a9-4b85-9b75-5275364c3f24 req-aff86924-4603-4d4a-8cd7-3387a34d7f24 service nova] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-6f970122-44a9-4b85-9b75-5275364c3f24 req-aff86924-4603-4d4a-8cd7-3387a34d7f24 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] No waiting events found dispatching network-vif-unplugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-6f970122-44a9-4b85-9b75-5275364c3f24 req-aff86924-4603-4d4a-8cd7-3387a34d7f24 service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received event network-vif-unplugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:15:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Instance destroyed successfully.
Aug 15 02:15:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'resources' on Instance uuid 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-53239991',display_name='tempest-AttachVolumeNegativeTest-server-53239991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-53239991',id=31,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQeBdaqy7+JhiiZW+8vzKowe3j1ZZUPCVWovaOBbKhTNsJoCB31CTl63H3F3hDB1Qg6rddAxB5NvAQHUEjYA3N2SuUG5qBSDR3YYSD29iGSArk+b5hKKphmBTFZLAvliA==',key_name='tempest-keypair-1782204711',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:12:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-l5vszd0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:12:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=421fb8ac-c579-469a-9dda-e6ea7e2f6b48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "address": "fa:16:3e:e1:97:5c", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b00c9c-51", "ovs_interfaceid": "51b00c9c-5181-4b2d-ba59-24eb2a4eb11a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:97:5c,bridge_name='br-int',has_traffic_filtering=True,id=51b00c9c-5181-4b2d-ba59-24eb2a4eb11a,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b00c9c-51') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG os_vif [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:97:5c,bridge_name='br-int',has_traffic_filtering=True,id=51b00c9c-5181-4b2d-ba59-24eb2a4eb11a,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b00c9c-51') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51b00c9c-51, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:15:02 user nova-compute[73121]: INFO os_vif [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:97:5c,bridge_name='br-int',has_traffic_filtering=True,id=51b00c9c-5181-4b2d-ba59-24eb2a4eb11a,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b00c9c-51')
Aug 15 02:15:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Deleting instance files /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48_del
Aug 15 02:15:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Deletion of /opt/stack/data/nova/instances/421fb8ac-c579-469a-9dda-e6ea7e2f6b48_del complete
Aug 15 02:15:02 user nova-compute[73121]: INFO nova.compute.manager [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 15 02:15:02 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:15:02 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:03 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Took 0.88 seconds to deallocate network for instance.
Aug 15 02:15:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-602dea81-7c25-4b0f-bbb5-cc80cc14c832 req-385a7ec6-e6cb-4ec3-8af7-3b69001d595a service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received event network-vif-deleted-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-a3555cd9-8814-48d9-ac72-c50687ddfbdb req-f4f10f94-adee-4f97-b6bd-f102a3e76dfd service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received event network-vif-plugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a3555cd9-8814-48d9-ac72-c50687ddfbdb req-f4f10f94-adee-4f97-b6bd-f102a3e76dfd service nova] Acquiring lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a3555cd9-8814-48d9-ac72-c50687ddfbdb req-f4f10f94-adee-4f97-b6bd-f102a3e76dfd service nova] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a3555cd9-8814-48d9-ac72-c50687ddfbdb req-f4f10f94-adee-4f97-b6bd-f102a3e76dfd service nova] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-a3555cd9-8814-48d9-ac72-c50687ddfbdb req-f4f10f94-adee-4f97-b6bd-f102a3e76dfd service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] No waiting events found dispatching network-vif-plugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:03 user nova-compute[73121]: WARNING nova.compute.manager [req-a3555cd9-8814-48d9-ac72-c50687ddfbdb req-f4f10f94-adee-4f97-b6bd-f102a3e76dfd service nova] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Received unexpected event network-vif-plugged-51b00c9c-5181-4b2d-ba59-24eb2a4eb11a for instance with vm_state deleted and task_state None.
Aug 15 02:15:03 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:15:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.418s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:03 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Deleted allocations for instance 421fb8ac-c579-469a-9dda-e6ea7e2f6b48
Aug 15 02:15:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa01b64b-4b97-468a-b2c3-e942e13a24e3 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "421fb8ac-c579-469a-9dda-e6ea7e2f6b48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.598s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:06 user nova-compute[73121]: INFO nova.compute.manager [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Terminating instance
Aug 15 02:15:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:15:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Instance destroyed successfully.
Aug 15 02:15:07 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'resources' on Instance uuid be6f8247-2be1-4add-92e9-54e4bef5c44c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-855829615',display_name='tempest-ServerActionsTestOtherA-server-692697073',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-855829615',id=25,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcIcrbhJjrYWhm7yxLzom3j8e7JktsAHxdqN24zjZeszcJu/7p3089G9bv7YEcqWJNb7rGjE2FAn8nBvFRG6CPZwnjnAtpFtfW5CD7QywBzacqZTRd6YdGBKys72Rxgfw==',key_name='tempest-keypair-1324962593',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:11:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-10b7bgr8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:11:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=be6f8247-2be1-4add-92e9-54e4bef5c44c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "address": "fa:16:3e:28:50:2c", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cff72bc-b5", "ovs_interfaceid": "5cff72bc-b5f5-4ac2-a334-0672a871e44b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG os_vif [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cff72bc-b5, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:15:07 user nova-compute[73121]: INFO os_vif [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:50:2c,bridge_name='br-int',has_traffic_filtering=True,id=5cff72bc-b5f5-4ac2-a334-0672a871e44b,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cff72bc-b5')
Aug 15 02:15:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Deleting instance files /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c_del
Aug 15 02:15:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Deletion of /opt/stack/data/nova/instances/be6f8247-2be1-4add-92e9-54e4bef5c44c_del complete
Aug 15 02:15:07 user nova-compute[73121]: INFO nova.compute.manager [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 15 02:15:07 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-12806ad2-0236-47da-81a1-c84163668bda req-f497ca2e-e5c7-4ba5-b8bb-6c990bae0c10 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-unplugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-12806ad2-0236-47da-81a1-c84163668bda req-f497ca2e-e5c7-4ba5-b8bb-6c990bae0c10 service nova] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-12806ad2-0236-47da-81a1-c84163668bda req-f497ca2e-e5c7-4ba5-b8bb-6c990bae0c10 service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-12806ad2-0236-47da-81a1-c84163668bda req-f497ca2e-e5c7-4ba5-b8bb-6c990bae0c10 service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-12806ad2-0236-47da-81a1-c84163668bda req-f497ca2e-e5c7-4ba5-b8bb-6c990bae0c10 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] No waiting events found dispatching network-vif-unplugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-12806ad2-0236-47da-81a1-c84163668bda req-f497ca2e-e5c7-4ba5-b8bb-6c990bae0c10 service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-unplugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:15:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:08 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-a0e01516-30b4-4d17-942f-ea7d73b2d1c8 req-a79d7d0d-7669-4344-8e53-933df5954f4d service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-deleted-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:08 user nova-compute[73121]: INFO nova.compute.manager [req-a0e01516-30b4-4d17-942f-ea7d73b2d1c8 req-a79d7d0d-7669-4344-8e53-933df5954f4d service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Neutron deleted interface 5cff72bc-b5f5-4ac2-a334-0672a871e44b; detaching it from the instance and deleting it from the info cache
Aug 15 02:15:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-a0e01516-30b4-4d17-942f-ea7d73b2d1c8 req-a79d7d0d-7669-4344-8e53-933df5954f4d service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:08 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Took 0.97 seconds to deallocate network for instance.
Aug 15 02:15:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-a0e01516-30b4-4d17-942f-ea7d73b2d1c8 req-a79d7d0d-7669-4344-8e53-933df5954f4d service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Detach interface failed, port_id=5cff72bc-b5f5-4ac2-a334-0672a871e44b, reason: Instance be6f8247-2be1-4add-92e9-54e4bef5c44c could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:15:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:08 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:15:08 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:15:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:08 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Deleted allocations for instance be6f8247-2be1-4add-92e9-54e4bef5c44c
Aug 15 02:15:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f7dfe4e3-d642-4792-83b7-378a1e585727 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.706s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-df218421-56ee-45f9-a884-03ea974ce51e req-baf4afdc-47ad-4a4c-96c6-d027b0861ecc service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-df218421-56ee-45f9-a884-03ea974ce51e req-baf4afdc-47ad-4a4c-96c6-d027b0861ecc service nova] Acquiring lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-df218421-56ee-45f9-a884-03ea974ce51e req-baf4afdc-47ad-4a4c-96c6-d027b0861ecc service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-df218421-56ee-45f9-a884-03ea974ce51e req-baf4afdc-47ad-4a4c-96c6-d027b0861ecc service nova] Lock "be6f8247-2be1-4add-92e9-54e4bef5c44c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-df218421-56ee-45f9-a884-03ea974ce51e req-baf4afdc-47ad-4a4c-96c6-d027b0861ecc service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] No waiting events found dispatching network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:09 user nova-compute[73121]: WARNING nova.compute.manager [req-df218421-56ee-45f9-a884-03ea974ce51e req-baf4afdc-47ad-4a4c-96c6-d027b0861ecc service nova] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Received unexpected event network-vif-plugged-5cff72bc-b5f5-4ac2-a334-0672a871e44b for instance with vm_state deleted and task_state None.
Aug 15 02:15:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-c9770f62-d460-46f2-97b8-f28194cbbd21 req-404d0518-d88d-4ec9-ba0f-722fcee70db0 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received event network-changed-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-c9770f62-d460-46f2-97b8-f28194cbbd21 req-404d0518-d88d-4ec9-ba0f-722fcee70db0 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Refreshing instance network info cache due to event network-changed-d527648c-0376-4bff-a360-c4e83daa61cd. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c9770f62-d460-46f2-97b8-f28194cbbd21 req-404d0518-d88d-4ec9-ba0f-722fcee70db0 service nova] Acquiring lock "refresh_cache-f1c5e851-4933-4db6-b7d5-ec2b417ec259" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c9770f62-d460-46f2-97b8-f28194cbbd21 req-404d0518-d88d-4ec9-ba0f-722fcee70db0 service nova] Acquired lock "refresh_cache-f1c5e851-4933-4db6-b7d5-ec2b417ec259" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG nova.network.neutron [req-c9770f62-d460-46f2-97b8-f28194cbbd21 req-404d0518-d88d-4ec9-ba0f-722fcee70db0 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Refreshing network info cache for port d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG nova.network.neutron [req-c9770f62-d460-46f2-97b8-f28194cbbd21 req-404d0518-d88d-4ec9-ba0f-722fcee70db0 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Updated VIF entry in instance network info cache for port d527648c-0376-4bff-a360-c4e83daa61cd. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG nova.network.neutron [req-c9770f62-d460-46f2-97b8-f28194cbbd21 req-404d0518-d88d-4ec9-ba0f-722fcee70db0 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Updating instance_info_cache with network_info: [{"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c9770f62-d460-46f2-97b8-f28194cbbd21 req-404d0518-d88d-4ec9-ba0f-722fcee70db0 service nova] Releasing lock "refresh_cache-f1c5e851-4933-4db6-b7d5-ec2b417ec259" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:11 user nova-compute[73121]: INFO nova.compute.manager [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Terminating instance
Aug 15 02:15:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-3943e952-4bb1-4cbb-a49b-fec9306aac46 req-43a199df-03c3-46a1-9276-269aebbb91cf service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received event network-vif-unplugged-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3943e952-4bb1-4cbb-a49b-fec9306aac46 req-43a199df-03c3-46a1-9276-269aebbb91cf service nova] Acquiring lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3943e952-4bb1-4cbb-a49b-fec9306aac46 req-43a199df-03c3-46a1-9276-269aebbb91cf service nova] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3943e952-4bb1-4cbb-a49b-fec9306aac46 req-43a199df-03c3-46a1-9276-269aebbb91cf service nova] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-3943e952-4bb1-4cbb-a49b-fec9306aac46 req-43a199df-03c3-46a1-9276-269aebbb91cf service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] No waiting events found dispatching network-vif-unplugged-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-3943e952-4bb1-4cbb-a49b-fec9306aac46 req-43a199df-03c3-46a1-9276-269aebbb91cf service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received event network-vif-unplugged-d527648c-0376-4bff-a360-c4e83daa61cd for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Instance destroyed successfully.
Aug 15 02:15:12 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'resources' on Instance uuid f1c5e851-4933-4db6-b7d5-ec2b417ec259 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:13:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-806136339',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-806136339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-806136339',id=32,image_ref='b8476d0a-3d15-4067-9de8-a31854efe25d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuTwelD3DVunMc71bTDe33ErM2NFIPpNvhiwS7/4HKdd/F1v6CH8e/4PeD1CjyU/K65cWbfHLiYxPOzGyEHPiOUsN9/zdtF3l1CFX9RvvdstF4GRjfs0JJEPJtc5ADJUg==',key_name='tempest-keypair-952608114',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:13:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-cdjwl0n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-151395753',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:13:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=f1c5e851-4933-4db6-b7d5-ec2b417ec259,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "d527648c-0376-4bff-a360-c4e83daa61cd", "address": "fa:16:3e:eb:29:93", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd527648c-03", "ovs_interfaceid": "d527648c-0376-4bff-a360-c4e83daa61cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:29:93,bridge_name='br-int',has_traffic_filtering=True,id=d527648c-0376-4bff-a360-c4e83daa61cd,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd527648c-03') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_vif [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:29:93,bridge_name='br-int',has_traffic_filtering=True,id=d527648c-0376-4bff-a360-c4e83daa61cd,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd527648c-03') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd527648c-03, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:15:12 user nova-compute[73121]: INFO os_vif [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:29:93,bridge_name='br-int',has_traffic_filtering=True,id=d527648c-0376-4bff-a360-c4e83daa61cd,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd527648c-03')
Aug 15 02:15:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yxUKSLFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:15:12 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[344715df-cdf9-45dc-8b16-f6f1b99c5728]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4db37af-98dc-40ef-a2c3-3dae25964359]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:15:12 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc68c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229'): ({'sdi'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Removing single pathed devices sdi {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da40c4d-0c70-4c10-aeb1-3e1147ac6afd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f68bac-18ab-43ec-b05d-d95bc531c3a6]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flushing IO for device /dev/sdi {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b206a573-9d81-400d-b6e0-b0cb57ccbc47]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.051s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf1d0c-b88d-4227-a674-a225c4da0923]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] SCSI volumes sdi have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7324f0-d31a-4630-a46c-7cfb5bbfc5f3]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[57680fc6-734a-4188-982f-15b275db2aab]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229, portal: 172.16.0.220,3260]
Aug 15 02:15:12 user nova-compute[73121]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229, portal: 172.16.0.220,3260] successful.
Aug 15 02:15:12 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97d60439-7cf9-40fc-9af2-fd340caa9229 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f379a1-bc79-4b31-9525-a5b84dd4c9c3]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== disconnect_volume: return (323ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:15:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:15:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Deleting instance files /opt/stack/data/nova/instances/f1c5e851-4933-4db6-b7d5-ec2b417ec259_del
Aug 15 02:15:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Deletion of /opt/stack/data/nova/instances/f1c5e851-4933-4db6-b7d5-ec2b417ec259_del complete
Aug 15 02:15:13 user nova-compute[73121]: INFO nova.compute.manager [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 15 02:15:13 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:15:13 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:15:13 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:15:13 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:13 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Took 0.97 seconds to deallocate network for instance.
Aug 15 02:15:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-60c7b0d4-268a-4b67-83c1-c8d3a3e8e057 req-8544765a-6a28-46a4-9a1e-77992c35d51f service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received event network-vif-deleted-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:14 user nova-compute[73121]: DEBUG nova.compute.manager [req-534a1af4-ab8f-46bd-844d-28836ddcf01a req-f8093a72-05df-4ae6-b742-60d0342696e8 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received event network-vif-plugged-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-534a1af4-ab8f-46bd-844d-28836ddcf01a req-f8093a72-05df-4ae6-b742-60d0342696e8 service nova] Acquiring lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-534a1af4-ab8f-46bd-844d-28836ddcf01a req-f8093a72-05df-4ae6-b742-60d0342696e8 service nova] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-534a1af4-ab8f-46bd-844d-28836ddcf01a req-f8093a72-05df-4ae6-b742-60d0342696e8 service nova] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:14 user nova-compute[73121]: DEBUG nova.compute.manager [req-534a1af4-ab8f-46bd-844d-28836ddcf01a req-f8093a72-05df-4ae6-b742-60d0342696e8 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] No waiting events found dispatching network-vif-plugged-d527648c-0376-4bff-a360-c4e83daa61cd {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:14 user nova-compute[73121]: WARNING nova.compute.manager [req-534a1af4-ab8f-46bd-844d-28836ddcf01a req-f8093a72-05df-4ae6-b742-60d0342696e8 service nova] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Received unexpected event network-vif-plugged-d527648c-0376-4bff-a360-c4e83daa61cd for instance with vm_state active and task_state deleting.
Aug 15 02:15:14 user nova-compute[73121]: INFO nova.compute.manager [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Took 0.82 seconds to detach 1 volumes for instance.
Aug 15 02:15:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Deleting volume: 97d60439-7cf9-40fc-9af2-fd340caa9229 {{(pid=73121) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 02:15:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:15 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:15:15 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:15:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.372s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:15 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Deleted allocations for instance f1c5e851-4933-4db6-b7d5-ec2b417ec259
Aug 15 02:15:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d184694-7dbd-45a1-bd9a-0e254c3b7ecb tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "f1c5e851-4933-4db6-b7d5-ec2b417ec259" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.635s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:17 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065702.296753, 421fb8ac-c579-469a-9dda-e6ea7e2f6b48 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:17 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] VM Stopped (Lifecycle Event)
Aug 15 02:15:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f69f1dc6-59bd-43c5-bdf0-be0b400c0726 None None] [instance: 421fb8ac-c579-469a-9dda-e6ea7e2f6b48] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:21 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:15:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:15:22 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065707.046269, be6f8247-2be1-4add-92e9-54e4bef5c44c => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:22 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] VM Stopped (Lifecycle Event)
Aug 15 02:15:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1eafbada-71a1-4c0b-9a95-a7a3ca8e727e None None] [instance: be6f8247-2be1-4add-92e9-54e4bef5c44c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:22 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:15:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:15:23 user nova-compute[73121]: INFO nova.compute.claims [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Claim successful on node user
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:15:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.policy [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f199d32620e4c0d9d48b9737d2f8f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7093d5ade03430488a4713acba49588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:15:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Creating image(s)
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "/opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "/opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "/opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.224s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk 1073741824" returned: 0 in 0.056s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.173s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Successfully created port: a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Cannot resize image /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'migration_context' on Instance uuid 2dd8fa27-d069-4e43-9789-34ec3ed2d371 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Ensure instance console log exists: /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Successfully updated port: a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "refresh_cache-2dd8fa27-d069-4e43-9789-34ec3ed2d371" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquired lock "refresh_cache-2dd8fa27-d069-4e43-9789-34ec3ed2d371" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-1e34accd-76de-4b81-a587-0a1df201bfa8 req-be8074d4-8afa-4e59-9f88-14522219750b service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received event network-changed-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-1e34accd-76de-4b81-a587-0a1df201bfa8 req-be8074d4-8afa-4e59-9f88-14522219750b service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Refreshing instance network info cache due to event network-changed-a1458fef-0602-4e19-8e52-c608a485e25f. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1e34accd-76de-4b81-a587-0a1df201bfa8 req-be8074d4-8afa-4e59-9f88-14522219750b service nova] Acquiring lock "refresh_cache-2dd8fa27-d069-4e43-9789-34ec3ed2d371" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:25 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Updating instance_info_cache with network_info: [{"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Releasing lock "refresh_cache-2dd8fa27-d069-4e43-9789-34ec3ed2d371" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Instance network_info: |[{"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1e34accd-76de-4b81-a587-0a1df201bfa8 req-be8074d4-8afa-4e59-9f88-14522219750b service nova] Acquired lock "refresh_cache-2dd8fa27-d069-4e43-9789-34ec3ed2d371" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.network.neutron [req-1e34accd-76de-4b81-a587-0a1df201bfa8 req-be8074d4-8afa-4e59-9f88-14522219750b service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Refreshing network info cache for port a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Start _get_guest_xml network_info=[{"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:15:26 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:15:26 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1417648587',display_name='tempest-VolumesSnapshotTestJSON-instance-1417648587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1417648587',id=33,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/JcAH98IJIVveVqI5dxaiwuiy7WUydF2dwuXcvQq/VVeOhLzujP0GnrUUOoJEb+hF32EQhlFjOE9/9MZfz7f2sbZsP5xIRY+3azX9dzTlj5mxU5RIX9jppagyGA+oMCQ==',key_name='tempest-keypair-1385308009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7093d5ade03430488a4713acba49588',ramdisk_id='',reservation_id='r-ke400qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1030319394',owner_user_name='tempest-VolumesSnapshotTestJSON-1030319394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f199d32620e4c0d9d48b9737d2f8f23',uuid=2dd8fa27-d069-4e43-9789-34ec3ed2d371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converting VIF {"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=a1458fef-0602-4e19-8e52-c608a485e25f,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1458fef-06') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'pci_devices' on Instance uuid 2dd8fa27-d069-4e43-9789-34ec3ed2d371 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:15:26 user nova-compute[73121]:   <uuid>2dd8fa27-d069-4e43-9789-34ec3ed2d371</uuid>
Aug 15 02:15:26 user nova-compute[73121]:   <name>instance-00000021</name>
Aug 15 02:15:26 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:15:26 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:15:26 user nova-compute[73121]:   <metadata>
Aug 15 02:15:26 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:15:26 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:15:26 user nova-compute[73121]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1417648587</nova:name>
Aug 15 02:15:26 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:15:26</nova:creationTime>
Aug 15 02:15:26 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:15:26 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:15:26 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:15:26 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:15:26 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:15:26 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:15:26 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:15:26 user nova-compute[73121]:       <nova:owner>
Aug 15 02:15:26 user nova-compute[73121]:         <nova:user uuid="7f199d32620e4c0d9d48b9737d2f8f23">tempest-VolumesSnapshotTestJSON-1030319394-project-member</nova:user>
Aug 15 02:15:26 user nova-compute[73121]:         <nova:project uuid="b7093d5ade03430488a4713acba49588">tempest-VolumesSnapshotTestJSON-1030319394</nova:project>
Aug 15 02:15:26 user nova-compute[73121]:       </nova:owner>
Aug 15 02:15:26 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:15:26 user nova-compute[73121]:       <nova:ports>
Aug 15 02:15:26 user nova-compute[73121]:         <nova:port uuid="a1458fef-0602-4e19-8e52-c608a485e25f">
Aug 15 02:15:26 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 02:15:26 user nova-compute[73121]:         </nova:port>
Aug 15 02:15:26 user nova-compute[73121]:       </nova:ports>
Aug 15 02:15:26 user nova-compute[73121]:     </nova:instance>
Aug 15 02:15:26 user nova-compute[73121]:   </metadata>
Aug 15 02:15:26 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:15:26 user nova-compute[73121]:     <system>
Aug 15 02:15:26 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:15:26 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:15:26 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:15:26 user nova-compute[73121]:       <entry name="serial">2dd8fa27-d069-4e43-9789-34ec3ed2d371</entry>
Aug 15 02:15:26 user nova-compute[73121]:       <entry name="uuid">2dd8fa27-d069-4e43-9789-34ec3ed2d371</entry>
Aug 15 02:15:26 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:15:26 user nova-compute[73121]:     </system>
Aug 15 02:15:26 user nova-compute[73121]:   </sysinfo>
Aug 15 02:15:26 user nova-compute[73121]:   <os>
Aug 15 02:15:26 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:15:26 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:15:26 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:15:26 user nova-compute[73121]:   </os>
Aug 15 02:15:26 user nova-compute[73121]:   <features>
Aug 15 02:15:26 user nova-compute[73121]:     <acpi/>
Aug 15 02:15:26 user nova-compute[73121]:     <apic/>
Aug 15 02:15:26 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:15:26 user nova-compute[73121]:   </features>
Aug 15 02:15:26 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:15:26 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:15:26 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:15:26 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:15:26 user nova-compute[73121]:   </clock>
Aug 15 02:15:26 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:15:26 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:15:26 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:15:26 user nova-compute[73121]:   </cpu>
Aug 15 02:15:26 user nova-compute[73121]:   <devices>
Aug 15 02:15:26 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:15:26 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:15:26 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk"/>
Aug 15 02:15:26 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:15:26 user nova-compute[73121]:     </disk>
Aug 15 02:15:26 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:15:26 user nova-compute[73121]:       <mac address="fa:16:3e:15:b1:68"/>
Aug 15 02:15:26 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:15:26 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:15:26 user nova-compute[73121]:       <target dev="tapa1458fef-06"/>
Aug 15 02:15:26 user nova-compute[73121]:     </interface>
Aug 15 02:15:26 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:15:26 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/console.log" append="off"/>
Aug 15 02:15:26 user nova-compute[73121]:     </serial>
Aug 15 02:15:26 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:15:26 user nova-compute[73121]:     <video>
Aug 15 02:15:26 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:15:26 user nova-compute[73121]:     </video>
Aug 15 02:15:26 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:15:26 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:15:26 user nova-compute[73121]:     </rng>
Aug 15 02:15:26 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:15:26 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:15:26 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:15:26 user nova-compute[73121]:     </memballoon>
Aug 15 02:15:26 user nova-compute[73121]:   </devices>
Aug 15 02:15:26 user nova-compute[73121]: </domain>
Aug 15 02:15:26 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1417648587',display_name='tempest-VolumesSnapshotTestJSON-instance-1417648587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1417648587',id=33,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/JcAH98IJIVveVqI5dxaiwuiy7WUydF2dwuXcvQq/VVeOhLzujP0GnrUUOoJEb+hF32EQhlFjOE9/9MZfz7f2sbZsP5xIRY+3azX9dzTlj5mxU5RIX9jppagyGA+oMCQ==',key_name='tempest-keypair-1385308009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7093d5ade03430488a4713acba49588',ramdisk_id='',reservation_id='r-ke400qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1030319394',owner_user_name='tempest-VolumesSnapshotTestJSON-1030319394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:15:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f199d32620e4c0d9d48b9737d2f8f23',uuid=2dd8fa27-d069-4e43-9789-34ec3ed2d371,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converting VIF {"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=a1458fef-0602-4e19-8e52-c608a485e25f,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1458fef-06') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG os_vif [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=a1458fef-0602-4e19-8e52-c608a485e25f,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1458fef-06') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1458fef-06, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1458fef-06, col_values=(('external_ids', {'iface-id': 'a1458fef-0602-4e19-8e52-c608a485e25f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:b1:68', 'vm-uuid': '2dd8fa27-d069-4e43-9789-34ec3ed2d371'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:26 user nova-compute[73121]: INFO os_vif [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=a1458fef-0602-4e19-8e52-c608a485e25f,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1458fef-06')
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No VIF found with MAC fa:16:3e:15:b1:68, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.network.neutron [req-1e34accd-76de-4b81-a587-0a1df201bfa8 req-be8074d4-8afa-4e59-9f88-14522219750b service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Updated VIF entry in instance network info cache for port a1458fef-0602-4e19-8e52-c608a485e25f. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG nova.network.neutron [req-1e34accd-76de-4b81-a587-0a1df201bfa8 req-be8074d4-8afa-4e59-9f88-14522219750b service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Updating instance_info_cache with network_info: [{"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1e34accd-76de-4b81-a587-0a1df201bfa8 req-be8074d4-8afa-4e59-9f88-14522219750b service nova] Releasing lock "refresh_cache-2dd8fa27-d069-4e43-9789-34ec3ed2d371" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065712.5565567, f1c5e851-4933-4db6-b7d5-ec2b417ec259 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:27 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] VM Stopped (Lifecycle Event)
Aug 15 02:15:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a13b99d8-16e3-4088-8b3e-a5b020eaef3b None None] [instance: f1c5e851-4933-4db6-b7d5-ec2b417ec259] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-6ff49421-71df-45d5-b6de-25fb704fe99a req-fd182826-f2e4-44f7-9650-cbc4f6c92745 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received event network-vif-plugged-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ff49421-71df-45d5-b6de-25fb704fe99a req-fd182826-f2e4-44f7-9650-cbc4f6c92745 service nova] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ff49421-71df-45d5-b6de-25fb704fe99a req-fd182826-f2e4-44f7-9650-cbc4f6c92745 service nova] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ff49421-71df-45d5-b6de-25fb704fe99a req-fd182826-f2e4-44f7-9650-cbc4f6c92745 service nova] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-6ff49421-71df-45d5-b6de-25fb704fe99a req-fd182826-f2e4-44f7-9650-cbc4f6c92745 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] No waiting events found dispatching network-vif-plugged-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:27 user nova-compute[73121]: WARNING nova.compute.manager [req-6ff49421-71df-45d5-b6de-25fb704fe99a req-fd182826-f2e4-44f7-9650-cbc4f6c92745 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received unexpected event network-vif-plugged-a1458fef-0602-4e19-8e52-c608a485e25f for instance with vm_state building and task_state spawning.
Aug 15 02:15:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065729.64855, 2dd8fa27-d069-4e43-9789-34ec3ed2d371 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:29 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] VM Resumed (Lifecycle Event)
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:15:29 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Instance spawned successfully.
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:15:29 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065729.6579127, 2dd8fa27-d069-4e43-9789-34ec3ed2d371 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:29 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] VM Started (Lifecycle Event)
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-c527e2bd-1a6a-4889-8943-c3df364d4b8c req-d5b00d76-5955-42a3-8ca3-5dfff2611c66 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received event network-vif-plugged-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c527e2bd-1a6a-4889-8943-c3df364d4b8c req-d5b00d76-5955-42a3-8ca3-5dfff2611c66 service nova] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c527e2bd-1a6a-4889-8943-c3df364d4b8c req-d5b00d76-5955-42a3-8ca3-5dfff2611c66 service nova] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c527e2bd-1a6a-4889-8943-c3df364d4b8c req-d5b00d76-5955-42a3-8ca3-5dfff2611c66 service nova] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-c527e2bd-1a6a-4889-8943-c3df364d4b8c req-d5b00d76-5955-42a3-8ca3-5dfff2611c66 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] No waiting events found dispatching network-vif-plugged-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:29 user nova-compute[73121]: WARNING nova.compute.manager [req-c527e2bd-1a6a-4889-8943-c3df364d4b8c req-d5b00d76-5955-42a3-8ca3-5dfff2611c66 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received unexpected event network-vif-plugged-a1458fef-0602-4e19-8e52-c608a485e25f for instance with vm_state building and task_state spawning.
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:29 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:15:29 user nova-compute[73121]: INFO nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Took 6.08 seconds to spawn the instance on the hypervisor.
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:29 user nova-compute[73121]: INFO nova.compute.manager [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Took 6.90 seconds to build instance.
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9ea62ee1-52ea-4d42-8943-8596455967c6 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:29 user nova-compute[73121]: INFO nova.compute.manager [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Terminating instance
Aug 15 02:15:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:15:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:30 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Instance destroyed successfully.
Aug 15 02:15:30 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lazy-loading 'resources' on Instance uuid 012c74eb-e477-42dc-a04e-908b51e82de1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-746478903',display_name='tempest-ServerStableDeviceRescueTest-server-746478903',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-746478903',id=23,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRwC8YL0jzZcbZMy9BtwKYjRwTz5ZrvOud6U5kgAzyZd8PjwLBMW46Zur0A8UvbTHnO18lr6q0qGSDAbNtQaNyNLrJ+lB9yNbU79Mn6ZlJzF6PuSExtaX1uEuGdot54jQ==',key_name='tempest-keypair-1186469442',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d90d41f123f4ef9bbaea3ca67b76e36',ramdisk_id='',reservation_id='r-zzr9ciut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-232377404',owner_user_name='tempest-ServerStableDeviceRescueTest-232377404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:14:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcd426e7c0ae4b179e08d2c6cbeb055d',uuid=012c74eb-e477-42dc-a04e-908b51e82de1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Converting VIF {"id": "eeb90096-6720-4d4b-954c-f03f3eeba489", "address": "fa:16:3e:6b:c7:ac", "network": {"id": "80d553b0-a83b-4da0-b037-c5c21ca2872f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1595162380-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d90d41f123f4ef9bbaea3ca67b76e36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeeb90096-67", "ovs_interfaceid": "eeb90096-6720-4d4b-954c-f03f3eeba489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:c7:ac,bridge_name='br-int',has_traffic_filtering=True,id=eeb90096-6720-4d4b-954c-f03f3eeba489,network=Network(80d553b0-a83b-4da0-b037-c5c21ca2872f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb90096-67') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG os_vif [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:c7:ac,bridge_name='br-int',has_traffic_filtering=True,id=eeb90096-6720-4d4b-954c-f03f3eeba489,network=Network(80d553b0-a83b-4da0-b037-c5c21ca2872f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb90096-67') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeeb90096-67, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:15:30 user nova-compute[73121]: INFO os_vif [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:c7:ac,bridge_name='br-int',has_traffic_filtering=True,id=eeb90096-6720-4d4b-954c-f03f3eeba489,network=Network(80d553b0-a83b-4da0-b037-c5c21ca2872f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeeb90096-67')
Aug 15 02:15:30 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Deleting instance files /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1_del
Aug 15 02:15:30 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Deletion of /opt/stack/data/nova/instances/012c74eb-e477-42dc-a04e-908b51e82de1_del complete
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:30 user nova-compute[73121]: INFO nova.compute.manager [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 02:15:30 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:15:30 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:15:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-unplugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-unplugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-unplugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] Acquiring lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] Lock "012c74eb-e477-42dc-a04e-908b51e82de1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] No waiting events found dispatching network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:32 user nova-compute[73121]: WARNING nova.compute.manager [req-e594d7e5-2834-4b88-b2ac-dfc116b169ae req-c3df8de2-5124-4a83-a9bf-367adc2d1d2d service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received unexpected event network-vif-plugged-eeb90096-6720-4d4b-954c-f03f3eeba489 for instance with vm_state active and task_state deleting.
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-a4ccda00-d482-4e38-be90-9e2379cb39e2 req-9bfd8655-d4e5-4c9b-9296-3c405186b661 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Received event network-vif-deleted-eeb90096-6720-4d4b-954c-f03f3eeba489 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:32 user nova-compute[73121]: INFO nova.compute.manager [req-a4ccda00-d482-4e38-be90-9e2379cb39e2 req-9bfd8655-d4e5-4c9b-9296-3c405186b661 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Neutron deleted interface eeb90096-6720-4d4b-954c-f03f3eeba489; detaching it from the instance and deleting it from the info cache
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.network.neutron [req-a4ccda00-d482-4e38-be90-9e2379cb39e2 req-9bfd8655-d4e5-4c9b-9296-3c405186b661 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:32 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:15:32 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7463MB free_disk=25.094566345214844GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:32 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Took 1.37 seconds to deallocate network for instance.
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-a4ccda00-d482-4e38-be90-9e2379cb39e2 req-9bfd8655-d4e5-4c9b-9296-3c405186b661 service nova] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Detach interface failed, port_id=eeb90096-6720-4d4b-954c-f03f3eeba489, reason: Instance 012c74eb-e477-42dc-a04e-908b51e82de1 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 012c74eb-e477-42dc-a04e-908b51e82de1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7950f28-0893-49de-a560-bbc0791492b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance afb831b1-b2b9-4771-a759-47fbaa2a0382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 00d2c851-39b9-40cb-8bac-785c954800cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance bc351c09-798d-4048-b80f-0dbf85344edb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d5b2095f-df4e-4420-9dca-4552b10e3f3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.414s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:33 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:15:33 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:15:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:33 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Deleted allocations for instance 012c74eb-e477-42dc-a04e-908b51e82de1
Aug 15 02:15:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ae27fba0-e131-49cd-898f-19c91ef0e610 tempest-ServerStableDeviceRescueTest-232377404 tempest-ServerStableDeviceRescueTest-232377404-project-member] Lock "012c74eb-e477-42dc-a04e-908b51e82de1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.311s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:33 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:15:33 user nova-compute[73121]: INFO nova.compute.manager [None req-f8e38144-596c-43bf-845b-481b417f5d64 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Unrescuing
Aug 15 02:15:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f8e38144-596c-43bf-845b-481b417f5d64 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f8e38144-596c-43bf-845b-481b417f5d64 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquired lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:33 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f8e38144-596c-43bf-845b-481b417f5d64 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f8e38144-596c-43bf-845b-481b417f5d64 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Updating instance_info_cache with network_info: [{"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f8e38144-596c-43bf-845b-481b417f5d64 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Releasing lock "refresh_cache-d5b2095f-df4e-4420-9dca-4552b10e3f3e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f8e38144-596c-43bf-845b-481b417f5d64 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'flavor' on Instance uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-855855de-d842-4c34-9513-b9ab29cc4d43 req-50b37294-8ab0-490f-8cd0-22b1e9cc8f2b service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-unplugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-855855de-d842-4c34-9513-b9ab29cc4d43 req-50b37294-8ab0-490f-8cd0-22b1e9cc8f2b service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-855855de-d842-4c34-9513-b9ab29cc4d43 req-50b37294-8ab0-490f-8cd0-22b1e9cc8f2b service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-855855de-d842-4c34-9513-b9ab29cc4d43 req-50b37294-8ab0-490f-8cd0-22b1e9cc8f2b service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-855855de-d842-4c34-9513-b9ab29cc4d43 req-50b37294-8ab0-490f-8cd0-22b1e9cc8f2b service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-unplugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:34 user nova-compute[73121]: WARNING nova.compute.manager [req-855855de-d842-4c34-9513-b9ab29cc4d43 req-50b37294-8ab0-490f-8cd0-22b1e9cc8f2b service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-unplugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:15:35 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance destroyed successfully.
Aug 15 02:15:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-5ffc1cad-eafd-4b79-b125-181f860de8df req-2453490d-3c91-4d71-b43f-d091e0be6f71 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5ffc1cad-eafd-4b79-b125-181f860de8df req-2453490d-3c91-4d71-b43f-d091e0be6f71 service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5ffc1cad-eafd-4b79-b125-181f860de8df req-2453490d-3c91-4d71-b43f-d091e0be6f71 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5ffc1cad-eafd-4b79-b125-181f860de8df req-2453490d-3c91-4d71-b43f-d091e0be6f71 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-5ffc1cad-eafd-4b79-b125-181f860de8df req-2453490d-3c91-4d71-b43f-d091e0be6f71 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:36 user nova-compute[73121]: WARNING nova.compute.manager [req-5ffc1cad-eafd-4b79-b125-181f860de8df req-2453490d-3c91-4d71-b43f-d091e0be6f71 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:15:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for d5b2095f-df4e-4420-9dca-4552b10e3f3e due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065738.7702117, d5b2095f-df4e-4420-9dca-4552b10e3f3e => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] VM Resumed (Lifecycle Event)
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f8e38144-596c-43bf-845b-481b417f5d64 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:15:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065738.7808506, d5b2095f-df4e-4420-9dca-4552b10e3f3e => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] VM Started (Lifecycle Event)
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-89450829-19f0-4bf8-8e68-ad31ff782c23 req-336f2c1d-9251-4728-b64e-7062bb384680 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-89450829-19f0-4bf8-8e68-ad31ff782c23 req-336f2c1d-9251-4728-b64e-7062bb384680 service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-89450829-19f0-4bf8-8e68-ad31ff782c23 req-336f2c1d-9251-4728-b64e-7062bb384680 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-89450829-19f0-4bf8-8e68-ad31ff782c23 req-336f2c1d-9251-4728-b64e-7062bb384680 service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-89450829-19f0-4bf8-8e68-ad31ff782c23 req-336f2c1d-9251-4728-b64e-7062bb384680 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:38 user nova-compute[73121]: WARNING nova.compute.manager [req-89450829-19f0-4bf8-8e68-ad31ff782c23 req-336f2c1d-9251-4728-b64e-7062bb384680 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state active and task_state None.
Aug 15 02:15:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-5c5ddb0b-740a-47da-811e-5177c06955c4 req-5d92a4be-dce1-45f6-bba7-ad4969af10ae service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5c5ddb0b-740a-47da-811e-5177c06955c4 req-5d92a4be-dce1-45f6-bba7-ad4969af10ae service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5c5ddb0b-740a-47da-811e-5177c06955c4 req-5d92a4be-dce1-45f6-bba7-ad4969af10ae service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5c5ddb0b-740a-47da-811e-5177c06955c4 req-5d92a4be-dce1-45f6-bba7-ad4969af10ae service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-5c5ddb0b-740a-47da-811e-5177c06955c4 req-5d92a4be-dce1-45f6-bba7-ad4969af10ae service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:41 user nova-compute[73121]: WARNING nova.compute.manager [req-5c5ddb0b-740a-47da-811e-5177c06955c4 req-5d92a4be-dce1-45f6-bba7-ad4969af10ae service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state active and task_state None.
Aug 15 02:15:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:15:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:15:42 user nova-compute[73121]: INFO nova.compute.claims [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Claim successful on node user
Aug 15 02:15:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:42 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:15:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:15:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:15:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:15:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG nova.policy [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '960751aa323442baa938225afc04d825', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8d2c7595ca84d28af1b3ed80af23083', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:15:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Creating image(s)
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "/opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "/opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "/opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:43 user nova-compute[73121]: INFO nova.compute.manager [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attaching volume 261837a4-0618-4e8b-92ba-64ea30e1fb22 to /dev/vdb
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG os_brick.utils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6cd9eb-9174-4f01-820c-55f8316bc271]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[97039fde-c3e3-4108-832f-81425c801db3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc9f4a9-8afe-4d17-af99-dce5b5c60e1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[33215367-b778-4421-821e-e1ff9f5a7e4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:15:43 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba442f1-3ce5-43ca-894a-775df3771296]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG os_brick.utils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updating existing volume attachment record: 739cc526-9f95-41ec-8eef-c5c7a9cd52bd {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk 1073741824" returned: 0 in 0.055s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:15:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Successfully created port: 32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Cannot resize image /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.objects.instance [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lazy-loading 'migration_context' on Instance uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Ensure instance console log exists: /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Successfully updated port: 32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "refresh_cache-1145ac04-f2f8-49d3-a54e-365f7269d8be" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquired lock "refresh_cache-1145ac04-f2f8-49d3-a54e-365f7269d8be" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-a466adc9-2745-402d-afce-04934f6b106a req-0ea945bd-9afe-4d21-a971-52036b2ff48f service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received event network-changed-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-a466adc9-2745-402d-afce-04934f6b106a req-0ea945bd-9afe-4d21-a971-52036b2ff48f service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Refreshing instance network info cache due to event network-changed-32084794-2862-47ab-b42f-d7d464ced12c. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a466adc9-2745-402d-afce-04934f6b106a req-0ea945bd-9afe-4d21-a971-52036b2ff48f service nova] Acquiring lock "refresh_cache-1145ac04-f2f8-49d3-a54e-365f7269d8be" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.network.neutron [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Updating instance_info_cache with network_info: [{"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Releasing lock "refresh_cache-1145ac04-f2f8-49d3-a54e-365f7269d8be" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Instance network_info: |[{"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a466adc9-2745-402d-afce-04934f6b106a req-0ea945bd-9afe-4d21-a971-52036b2ff48f service nova] Acquired lock "refresh_cache-1145ac04-f2f8-49d3-a54e-365f7269d8be" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.network.neutron [req-a466adc9-2745-402d-afce-04934f6b106a req-0ea945bd-9afe-4d21-a971-52036b2ff48f service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Refreshing network info cache for port 32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Start _get_guest_xml network_info=[{"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:15:45 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:15:45 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-918626307',display_name='tempest-TestServerVolumeAttachmentScenario-server-918626307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-918626307',id=34,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvAxvKWo4lmNaemXtxJ+WeoYTeTQHUwrbgik4L76i7oTL26+E5lAuRVYy9PbCtZhPfkgIXXUvTcxuFLec98hpHY6OoSr1gXdYsIVX6zwzHXk00X2iirNBYIT6gP290Vjw==',key_name='tempest-keypair-435126425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8d2c7595ca84d28af1b3ed80af23083',ramdisk_id='',reservation_id='r-6w4k026t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2144598730',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2144598730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960751aa323442baa938225afc04d825',uuid=1145ac04-f2f8-49d3-a54e-365f7269d8be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Converting VIF {"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:dc:e8,bridge_name='br-int',has_traffic_filtering=True,id=32084794-2862-47ab-b42f-d7d464ced12c,network=Network(c2a0f6dc-7e55-4e7b-be97-e42be7495860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32084794-28') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.objects.instance [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lazy-loading 'pci_devices' on Instance uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:15:45 user nova-compute[73121]:   <uuid>1145ac04-f2f8-49d3-a54e-365f7269d8be</uuid>
Aug 15 02:15:45 user nova-compute[73121]:   <name>instance-00000022</name>
Aug 15 02:15:45 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:15:45 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:15:45 user nova-compute[73121]:   <metadata>
Aug 15 02:15:45 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:15:45 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:15:45 user nova-compute[73121]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-918626307</nova:name>
Aug 15 02:15:45 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:15:45</nova:creationTime>
Aug 15 02:15:45 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:15:45 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:15:45 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:15:45 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:15:45 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:15:45 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:15:45 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:15:45 user nova-compute[73121]:       <nova:owner>
Aug 15 02:15:45 user nova-compute[73121]:         <nova:user uuid="960751aa323442baa938225afc04d825">tempest-TestServerVolumeAttachmentScenario-2144598730-project-member</nova:user>
Aug 15 02:15:45 user nova-compute[73121]:         <nova:project uuid="b8d2c7595ca84d28af1b3ed80af23083">tempest-TestServerVolumeAttachmentScenario-2144598730</nova:project>
Aug 15 02:15:45 user nova-compute[73121]:       </nova:owner>
Aug 15 02:15:45 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:15:45 user nova-compute[73121]:       <nova:ports>
Aug 15 02:15:45 user nova-compute[73121]:         <nova:port uuid="32084794-2862-47ab-b42f-d7d464ced12c">
Aug 15 02:15:45 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 02:15:45 user nova-compute[73121]:         </nova:port>
Aug 15 02:15:45 user nova-compute[73121]:       </nova:ports>
Aug 15 02:15:45 user nova-compute[73121]:     </nova:instance>
Aug 15 02:15:45 user nova-compute[73121]:   </metadata>
Aug 15 02:15:45 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:15:45 user nova-compute[73121]:     <system>
Aug 15 02:15:45 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:15:45 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:15:45 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:15:45 user nova-compute[73121]:       <entry name="serial">1145ac04-f2f8-49d3-a54e-365f7269d8be</entry>
Aug 15 02:15:45 user nova-compute[73121]:       <entry name="uuid">1145ac04-f2f8-49d3-a54e-365f7269d8be</entry>
Aug 15 02:15:45 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:15:45 user nova-compute[73121]:     </system>
Aug 15 02:15:45 user nova-compute[73121]:   </sysinfo>
Aug 15 02:15:45 user nova-compute[73121]:   <os>
Aug 15 02:15:45 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:15:45 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:15:45 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:15:45 user nova-compute[73121]:   </os>
Aug 15 02:15:45 user nova-compute[73121]:   <features>
Aug 15 02:15:45 user nova-compute[73121]:     <acpi/>
Aug 15 02:15:45 user nova-compute[73121]:     <apic/>
Aug 15 02:15:45 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:15:45 user nova-compute[73121]:   </features>
Aug 15 02:15:45 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:15:45 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:15:45 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:15:45 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:15:45 user nova-compute[73121]:   </clock>
Aug 15 02:15:45 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:15:45 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:15:45 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:15:45 user nova-compute[73121]:   </cpu>
Aug 15 02:15:45 user nova-compute[73121]:   <devices>
Aug 15 02:15:45 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:15:45 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:15:45 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk"/>
Aug 15 02:15:45 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:15:45 user nova-compute[73121]:     </disk>
Aug 15 02:15:45 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:15:45 user nova-compute[73121]:       <mac address="fa:16:3e:78:dc:e8"/>
Aug 15 02:15:45 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:15:45 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:15:45 user nova-compute[73121]:       <target dev="tap32084794-28"/>
Aug 15 02:15:45 user nova-compute[73121]:     </interface>
Aug 15 02:15:45 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:15:45 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/console.log" append="off"/>
Aug 15 02:15:45 user nova-compute[73121]:     </serial>
Aug 15 02:15:45 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:15:45 user nova-compute[73121]:     <video>
Aug 15 02:15:45 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:15:45 user nova-compute[73121]:     </video>
Aug 15 02:15:45 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:15:45 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:15:45 user nova-compute[73121]:     </rng>
Aug 15 02:15:45 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:15:45 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:15:45 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:15:45 user nova-compute[73121]:     </memballoon>
Aug 15 02:15:45 user nova-compute[73121]:   </devices>
Aug 15 02:15:45 user nova-compute[73121]: </domain>
Aug 15 02:15:45 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-918626307',display_name='tempest-TestServerVolumeAttachmentScenario-server-918626307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-918626307',id=34,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvAxvKWo4lmNaemXtxJ+WeoYTeTQHUwrbgik4L76i7oTL26+E5lAuRVYy9PbCtZhPfkgIXXUvTcxuFLec98hpHY6OoSr1gXdYsIVX6zwzHXk00X2iirNBYIT6gP290Vjw==',key_name='tempest-keypair-435126425',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b8d2c7595ca84d28af1b3ed80af23083',ramdisk_id='',reservation_id='r-6w4k026t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2144598730',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2144598730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:15:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960751aa323442baa938225afc04d825',uuid=1145ac04-f2f8-49d3-a54e-365f7269d8be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Converting VIF {"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:dc:e8,bridge_name='br-int',has_traffic_filtering=True,id=32084794-2862-47ab-b42f-d7d464ced12c,network=Network(c2a0f6dc-7e55-4e7b-be97-e42be7495860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32084794-28') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG os_vif [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:dc:e8,bridge_name='br-int',has_traffic_filtering=True,id=32084794-2862-47ab-b42f-d7d464ced12c,network=Network(c2a0f6dc-7e55-4e7b-be97-e42be7495860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32084794-28') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32084794-28, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32084794-28, col_values=(('external_ids', {'iface-id': '32084794-2862-47ab-b42f-d7d464ced12c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:dc:e8', 'vm-uuid': '1145ac04-f2f8-49d3-a54e-365f7269d8be'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:45 user nova-compute[73121]: INFO os_vif [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:dc:e8,bridge_name='br-int',has_traffic_filtering=True,id=32084794-2862-47ab-b42f-d7d464ced12c,network=Network(c2a0f6dc-7e55-4e7b-be97-e42be7495860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32084794-28')
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065730.7703326, 012c74eb-e477-42dc-a04e-908b51e82de1 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:45 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] VM Stopped (Lifecycle Event)
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ec6eb960-74c9-4aea-91ab-f517eedcee45 None None] [instance: 012c74eb-e477-42dc-a04e-908b51e82de1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:15:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] No VIF found with MAC fa:16:3e:78:dc:e8, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:15:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-a466adc9-2745-402d-afce-04934f6b106a req-0ea945bd-9afe-4d21-a971-52036b2ff48f service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Updated VIF entry in instance network info cache for port 32084794-2862-47ab-b42f-d7d464ced12c. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:15:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-a466adc9-2745-402d-afce-04934f6b106a req-0ea945bd-9afe-4d21-a971-52036b2ff48f service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Updating instance_info_cache with network_info: [{"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a466adc9-2745-402d-afce-04934f6b106a req-0ea945bd-9afe-4d21-a971-52036b2ff48f service nova] Releasing lock "refresh_cache-1145ac04-f2f8-49d3-a54e-365f7269d8be" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-0646d8c7-b20a-459e-9d1d-ce2c9cf2d8b8 req-89a6ed50-b8cb-4e2d-bddf-4b48de94895e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-0646d8c7-b20a-459e-9d1d-ce2c9cf2d8b8 req-89a6ed50-b8cb-4e2d-bddf-4b48de94895e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing instance network info cache due to event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0646d8c7-b20a-459e-9d1d-ce2c9cf2d8b8 req-89a6ed50-b8cb-4e2d-bddf-4b48de94895e service nova] Acquiring lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0646d8c7-b20a-459e-9d1d-ce2c9cf2d8b8 req-89a6ed50-b8cb-4e2d-bddf-4b48de94895e service nova] Acquired lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-0646d8c7-b20a-459e-9d1d-ce2c9cf2d8b8 req-89a6ed50-b8cb-4e2d-bddf-4b48de94895e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-960cf1a8-1857-4aaa-9f6b-cf166616b987 req-a4a93139-f94a-4ffe-8e38-51c0a2c3b390 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received event network-vif-plugged-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-960cf1a8-1857-4aaa-9f6b-cf166616b987 req-a4a93139-f94a-4ffe-8e38-51c0a2c3b390 service nova] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-960cf1a8-1857-4aaa-9f6b-cf166616b987 req-a4a93139-f94a-4ffe-8e38-51c0a2c3b390 service nova] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-960cf1a8-1857-4aaa-9f6b-cf166616b987 req-a4a93139-f94a-4ffe-8e38-51c0a2c3b390 service nova] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-960cf1a8-1857-4aaa-9f6b-cf166616b987 req-a4a93139-f94a-4ffe-8e38-51c0a2c3b390 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] No waiting events found dispatching network-vif-plugged-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:47 user nova-compute[73121]: WARNING nova.compute.manager [req-960cf1a8-1857-4aaa-9f6b-cf166616b987 req-a4a93139-f94a-4ffe-8e38-51c0a2c3b390 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received unexpected event network-vif-plugged-32084794-2862-47ab-b42f-d7d464ced12c for instance with vm_state building and task_state spawning.
Aug 15 02:15:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-0646d8c7-b20a-459e-9d1d-ce2c9cf2d8b8 req-89a6ed50-b8cb-4e2d-bddf-4b48de94895e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updated VIF entry in instance network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-0646d8c7-b20a-459e-9d1d-ce2c9cf2d8b8 req-89a6ed50-b8cb-4e2d-bddf-4b48de94895e service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updating instance_info_cache with network_info: [{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0646d8c7-b20a-459e-9d1d-ce2c9cf2d8b8 req-89a6ed50-b8cb-4e2d-bddf-4b48de94895e service nova] Releasing lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:48 user nova-compute[73121]: INFO nova.compute.manager [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Detaching volume f7b28ba1-c5e0-47c2-9290-df72eb9b2575
Aug 15 02:15:48 user nova-compute[73121]: INFO nova.virt.block_device [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Attempting to driver detach volume f7b28ba1-c5e0-47c2-9290-df72eb9b2575 from mountpoint /dev/vdb
Aug 15 02:15:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Attempting to detach device vdb from instance bc351c09-798d-4048-b80f-0dbf85344edb from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:15:48 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:15:48 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:15:48 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:15:48 user nova-compute[73121]:   <serial>f7b28ba1-c5e0-47c2-9290-df72eb9b2575</serial>
Aug 15 02:15:48 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 02:15:48 user nova-compute[73121]: </disk>
Aug 15 02:15:48 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:15:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully detached device vdb from instance bc351c09-798d-4048-b80f-0dbf85344edb from the persistent domain config.
Aug 15 02:15:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc351c09-798d-4048-b80f-0dbf85344edb from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:15:48 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:15:48 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:15:48 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:15:48 user nova-compute[73121]:   <serial>f7b28ba1-c5e0-47c2-9290-df72eb9b2575</serial>
Aug 15 02:15:48 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 02:15:48 user nova-compute[73121]: </disk>
Aug 15 02:15:48 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065748.646304, bc351c09-798d-4048-b80f-0dbf85344edb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:15:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully detached device vdb from instance bc351c09-798d-4048-b80f-0dbf85344edb from the live domain config.
Aug 15 02:15:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xdeowFiM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:15:48 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[547d281d-674c-43d0-a97d-c88368d7c89f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7cdfbd-efec-4558-afb8-e8ed6aaf8c67]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:48 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:48 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:48 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:15:48 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:48 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:48 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:48 user nova-compute[73121]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 (non-flash)
Aug 15 02:15:48 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e319cb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575'): ({'sde'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Removing single pathed devices sde {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b0820d-0ffb-48cc-9377-d5c87277be19]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb26f14-799a-4330-b9ce-08be79110ef0]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Flushing IO for device /dev/sde {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6411ae8-fd19-4c86-8aa1-763cd306cedc]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[297b0663-e8f5-4c9f-bb0d-ae9e185b86c5]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[11da1591-8314-4cec-adb4-6f4e6698913d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[702860ba-a9c9-48a3-a79d-64e7bfc1fb17]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260]
Aug 15 02:15:48 user nova-compute[73121]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575, portal: 172.16.0.220,3260] successful.
Aug 15 02:15:48 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f7b28ba1-c5e0-47c2-9290-df72eb9b2575 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[18186092-7afe-4d9b-925c-f0a5f4654259]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] <== disconnect_volume: return (311ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:15:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-4f0a0f94-0d33-42bd-bea3-6a649a3aaa82 req-c43f712c-863a-4c16-9b97-32d92e08f2d2 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-4f0a0f94-0d33-42bd-bea3-6a649a3aaa82 req-c43f712c-863a-4c16-9b97-32d92e08f2d2 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing instance network info cache due to event network-changed-c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4f0a0f94-0d33-42bd-bea3-6a649a3aaa82 req-c43f712c-863a-4c16-9b97-32d92e08f2d2 service nova] Acquiring lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4f0a0f94-0d33-42bd-bea3-6a649a3aaa82 req-c43f712c-863a-4c16-9b97-32d92e08f2d2 service nova] Acquired lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-4f0a0f94-0d33-42bd-bea3-6a649a3aaa82 req-c43f712c-863a-4c16-9b97-32d92e08f2d2 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Refreshing network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-784b6ed5-f85f-4ad2-afd0-324e422334d4 req-e4a342e3-388b-488d-9a44-492a37ae457c service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received event network-vif-plugged-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-784b6ed5-f85f-4ad2-afd0-324e422334d4 req-e4a342e3-388b-488d-9a44-492a37ae457c service nova] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-784b6ed5-f85f-4ad2-afd0-324e422334d4 req-e4a342e3-388b-488d-9a44-492a37ae457c service nova] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-784b6ed5-f85f-4ad2-afd0-324e422334d4 req-e4a342e3-388b-488d-9a44-492a37ae457c service nova] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [req-784b6ed5-f85f-4ad2-afd0-324e422334d4 req-e4a342e3-388b-488d-9a44-492a37ae457c service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] No waiting events found dispatching network-vif-plugged-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:15:49 user nova-compute[73121]: WARNING nova.compute.manager [req-784b6ed5-f85f-4ad2-afd0-324e422334d4 req-e4a342e3-388b-488d-9a44-492a37ae457c service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received unexpected event network-vif-plugged-32084794-2862-47ab-b42f-d7d464ced12c for instance with vm_state building and task_state spawning.
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065749.6567001, 1145ac04-f2f8-49d3-a54e-365f7269d8be => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:49 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] VM Resumed (Lifecycle Event)
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:15:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Instance spawned successfully.
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:15:49 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065749.6604826, 1145ac04-f2f8-49d3-a54e-365f7269d8be => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:15:49 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] VM Started (Lifecycle Event)
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:15:49 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:15:49 user nova-compute[73121]: INFO nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-4f0a0f94-0d33-42bd-bea3-6a649a3aaa82 req-c43f712c-863a-4c16-9b97-32d92e08f2d2 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updated VIF entry in instance network info cache for port c315ab1b-2e05-4e8b-a995-849f3cb9249b. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-4f0a0f94-0d33-42bd-bea3-6a649a3aaa82 req-c43f712c-863a-4c16-9b97-32d92e08f2d2 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updating instance_info_cache with network_info: [{"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4f0a0f94-0d33-42bd-bea3-6a649a3aaa82 req-c43f712c-863a-4c16-9b97-32d92e08f2d2 service nova] Releasing lock "refresh_cache-bc351c09-798d-4048-b80f-0dbf85344edb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'flavor' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:49 user nova-compute[73121]: INFO nova.compute.manager [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Took 7.41 seconds to build instance.
Aug 15 02:15:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-73399563-07e5-46f7-a326-caa5954ac997 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.534s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-47ef0f8b-7d9c-450e-a2bb-64604edee7ba tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.853s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmjkyqoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:15:53 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:15:53 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:15:53 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d9d05e-7734-417e-9b77-390d8efdff9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:15:53 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ddd140-bcab-4e24-bc1c-c69ba924e7fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22] added
Aug 15 02:15:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4305fdcb-a550-4218-81ca-558f242a18ff]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[273b14af-3dc2-418a-989b-bbdd9e9a79bb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmjkyqoC {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JmjkyqoC" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cae46d7-fdf9-4ff3-bec3-cfe8adc2d60c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JmjkyqoC'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dff7cad-b17a-44b2-9ff8-a6f45db66c6e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ecbc22-a611-4f25-a216-0af2c22de5de]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ad00a-72d6-43f2-8037-5c61295ba652]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22, portal: 172.16.0.220,3260]
Aug 15 02:15:53 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22, portal: 172.16.0.220,3260] successful.
Aug 15 02:15:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3911fb11-e21f-4c59-bd80-e1e3e02512c0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d98358-cbf9-471a-840d-71e9ca0aadf1]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 (non-flash)
Aug 15 02:15:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:54 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[847394b5-2f4f-4ebe-bff6-58e943e34160]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:54 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmjkyqoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26132306434366465', 'path': '/dev/sdd'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132306434366465', 'path': '/dev/sdd'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:15:55 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:15:55 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:15:55 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:15:55 user nova-compute[73121]:   <serial>261837a4-0618-4e8b-92ba-64ea30e1fb22</serial>
Aug 15 02:15:55 user nova-compute[73121]: </disk>
Aug 15 02:15:55 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] No VIF found with MAC fa:16:3e:1c:c1:76, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b4bc538e-f2b4-45e0-ad23-09d9a5d28d84 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.414s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:15:56 user nova-compute[73121]: INFO nova.compute.claims [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Claim successful on node user
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.network.neutron [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:15:56 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.policy [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c1e20e779ac4711803956ee2a2accaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcc744b107dc4a8baa3274788b094e2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:15:56 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Creating image(s)
Aug 15 02:15:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "/opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "/opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.199s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk 1073741824" returned: 0 in 0.064s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG nova.network.neutron [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Successfully created port: b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Cannot resize image /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG nova.objects.instance [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'migration_context' on Instance uuid 9bfaa36f-2822-47de-8d12-823e38b4aae4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Ensure instance console log exists: /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:15:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:15:57 user nova-compute[73121]: INFO nova.compute.manager [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Detaching volume 261837a4-0618-4e8b-92ba-64ea30e1fb22
Aug 15 02:15:58 user nova-compute[73121]: INFO nova.virt.block_device [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Attempting to driver detach volume 261837a4-0618-4e8b-92ba-64ea30e1fb22 from mountpoint /dev/vdb
Aug 15 02:15:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Attempting to detach device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:15:58 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:15:58 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:15:58 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:15:58 user nova-compute[73121]:   <serial>261837a4-0618-4e8b-92ba-64ea30e1fb22</serial>
Aug 15 02:15:58 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:15:58 user nova-compute[73121]: </disk>
Aug 15 02:15:58 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:15:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully detached device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the persistent domain config.
Aug 15 02:15:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:15:58 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:15:58 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:15:58 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:15:58 user nova-compute[73121]:   <serial>261837a4-0618-4e8b-92ba-64ea30e1fb22</serial>
Aug 15 02:15:58 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:15:58 user nova-compute[73121]: </disk>
Aug 15 02:15:58 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065758.5252008, afb831b1-b2b9-4771-a759-47fbaa2a0382 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:15:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully detached device vdb from instance afb831b1-b2b9-4771-a759-47fbaa2a0382 from the live domain config.
Aug 15 02:15:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JmjkyqoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:15:58 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2988c9-bf1f-4f43-85f7-c58cb8b285db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63189dd-30cf-41b1-8097-2cffd12cd7d8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:58 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:58 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:58 user nova-compute[73121]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 (non-flash)
Aug 15 02:15:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:15:58 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:15:58 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:15:58 user nova-compute[73121]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 (non-flash)
Aug 15 02:15:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e336b9d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22'): ({'sdd'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Removing single pathed devices sdd {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d559733-f2b0-4622-b2c2-2dbeaba4f3f7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85fefad-6f9c-40c9-82a6-e06fcc626153]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Flushing IO for device /dev/sdd {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb67a74-a1eb-42c7-939f-4015574cea2f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[514c3583-dbd1-4c44-8d87-d594becac495]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8237542c-6bc3-40d3-ad9d-da78a69c1d2f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dc4366-9214-41e0-a06f-e06b38c9bb0f]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22, portal: 172.16.0.220,3260]
Aug 15 02:15:58 user nova-compute[73121]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22, portal: 172.16.0.220,3260] successful.
Aug 15 02:15:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:261837a4-0618-4e8b-92ba-64ea30e1fb22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd25ced6-f292-4651-af96-fff4a9eb099d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] <== disconnect_volume: return (309ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:15:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Successfully updated port: b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "refresh_cache-9bfaa36f-2822-47de-8d12-823e38b4aae4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquired lock "refresh_cache-9bfaa36f-2822-47de-8d12-823e38b4aae4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-c78e0447-016d-42ad-92c1-0068198e14b5 req-7c2d45f6-0d83-4ec1-a737-09ae6522da43 service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received event network-changed-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-c78e0447-016d-42ad-92c1-0068198e14b5 req-7c2d45f6-0d83-4ec1-a737-09ae6522da43 service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Refreshing instance network info cache due to event network-changed-b77ab60c-66e8-4d0e-998d-86d6053a465d. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c78e0447-016d-42ad-92c1-0068198e14b5 req-7c2d45f6-0d83-4ec1-a737-09ae6522da43 service nova] Acquiring lock "refresh_cache-9bfaa36f-2822-47de-8d12-823e38b4aae4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'flavor' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f6bf96b6-95eb-4390-9a9e-b2f435ed134c tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.750s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Updating instance_info_cache with network_info: [{"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Releasing lock "refresh_cache-9bfaa36f-2822-47de-8d12-823e38b4aae4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Instance network_info: |[{"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c78e0447-016d-42ad-92c1-0068198e14b5 req-7c2d45f6-0d83-4ec1-a737-09ae6522da43 service nova] Acquired lock "refresh_cache-9bfaa36f-2822-47de-8d12-823e38b4aae4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-c78e0447-016d-42ad-92c1-0068198e14b5 req-7c2d45f6-0d83-4ec1-a737-09ae6522da43 service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Refreshing network info cache for port b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Start _get_guest_xml network_info=[{"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:15:59 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:15:59 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1891893581',display_name='tempest-AttachVolumeNegativeTest-server-1891893581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1891893581',id=35,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuPSTHran1OJuZTKPhq9DUWJ5q5PF/VW/rGRkkhuoTSBMcGTILIMxsB/1PAoyCflltQMhMG34MRjM9QmDj1En1bG5d4XxbmZKp6cHLZwB5+pe8yT4ZySe9H/QscJ5ldjw==',key_name='tempest-keypair-1104148254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-3xvux490',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=9bfaa36f-2822-47de-8d12-823e38b4aae4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:9a:fb,bridge_name='br-int',has_traffic_filtering=True,id=b77ab60c-66e8-4d0e-998d-86d6053a465d,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77ab60c-66') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.objects.instance [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bfaa36f-2822-47de-8d12-823e38b4aae4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:15:59 user nova-compute[73121]:   <uuid>9bfaa36f-2822-47de-8d12-823e38b4aae4</uuid>
Aug 15 02:15:59 user nova-compute[73121]:   <name>instance-00000023</name>
Aug 15 02:15:59 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:15:59 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:15:59 user nova-compute[73121]:   <metadata>
Aug 15 02:15:59 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:15:59 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:15:59 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1891893581</nova:name>
Aug 15 02:15:59 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:15:59</nova:creationTime>
Aug 15 02:15:59 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:15:59 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:15:59 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:15:59 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:15:59 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:15:59 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:15:59 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:15:59 user nova-compute[73121]:       <nova:owner>
Aug 15 02:15:59 user nova-compute[73121]:         <nova:user uuid="5c1e20e779ac4711803956ee2a2accaa">tempest-AttachVolumeNegativeTest-2069847524-project-member</nova:user>
Aug 15 02:15:59 user nova-compute[73121]:         <nova:project uuid="fcc744b107dc4a8baa3274788b094e2d">tempest-AttachVolumeNegativeTest-2069847524</nova:project>
Aug 15 02:15:59 user nova-compute[73121]:       </nova:owner>
Aug 15 02:15:59 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:15:59 user nova-compute[73121]:       <nova:ports>
Aug 15 02:15:59 user nova-compute[73121]:         <nova:port uuid="b77ab60c-66e8-4d0e-998d-86d6053a465d">
Aug 15 02:15:59 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 02:15:59 user nova-compute[73121]:         </nova:port>
Aug 15 02:15:59 user nova-compute[73121]:       </nova:ports>
Aug 15 02:15:59 user nova-compute[73121]:     </nova:instance>
Aug 15 02:15:59 user nova-compute[73121]:   </metadata>
Aug 15 02:15:59 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:15:59 user nova-compute[73121]:     <system>
Aug 15 02:15:59 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:15:59 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:15:59 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:15:59 user nova-compute[73121]:       <entry name="serial">9bfaa36f-2822-47de-8d12-823e38b4aae4</entry>
Aug 15 02:15:59 user nova-compute[73121]:       <entry name="uuid">9bfaa36f-2822-47de-8d12-823e38b4aae4</entry>
Aug 15 02:15:59 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:15:59 user nova-compute[73121]:     </system>
Aug 15 02:15:59 user nova-compute[73121]:   </sysinfo>
Aug 15 02:15:59 user nova-compute[73121]:   <os>
Aug 15 02:15:59 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:15:59 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:15:59 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:15:59 user nova-compute[73121]:   </os>
Aug 15 02:15:59 user nova-compute[73121]:   <features>
Aug 15 02:15:59 user nova-compute[73121]:     <acpi/>
Aug 15 02:15:59 user nova-compute[73121]:     <apic/>
Aug 15 02:15:59 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:15:59 user nova-compute[73121]:   </features>
Aug 15 02:15:59 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:15:59 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:15:59 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:15:59 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:15:59 user nova-compute[73121]:   </clock>
Aug 15 02:15:59 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:15:59 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:15:59 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:15:59 user nova-compute[73121]:   </cpu>
Aug 15 02:15:59 user nova-compute[73121]:   <devices>
Aug 15 02:15:59 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:15:59 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:15:59 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk"/>
Aug 15 02:15:59 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:15:59 user nova-compute[73121]:     </disk>
Aug 15 02:15:59 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:15:59 user nova-compute[73121]:       <mac address="fa:16:3e:7a:9a:fb"/>
Aug 15 02:15:59 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:15:59 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:15:59 user nova-compute[73121]:       <target dev="tapb77ab60c-66"/>
Aug 15 02:15:59 user nova-compute[73121]:     </interface>
Aug 15 02:15:59 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:15:59 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/console.log" append="off"/>
Aug 15 02:15:59 user nova-compute[73121]:     </serial>
Aug 15 02:15:59 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:15:59 user nova-compute[73121]:     <video>
Aug 15 02:15:59 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:15:59 user nova-compute[73121]:     </video>
Aug 15 02:15:59 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:15:59 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:15:59 user nova-compute[73121]:     </rng>
Aug 15 02:15:59 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:15:59 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:15:59 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:15:59 user nova-compute[73121]:     </memballoon>
Aug 15 02:15:59 user nova-compute[73121]:   </devices>
Aug 15 02:15:59 user nova-compute[73121]: </domain>
Aug 15 02:15:59 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1891893581',display_name='tempest-AttachVolumeNegativeTest-server-1891893581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1891893581',id=35,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuPSTHran1OJuZTKPhq9DUWJ5q5PF/VW/rGRkkhuoTSBMcGTILIMxsB/1PAoyCflltQMhMG34MRjM9QmDj1En1bG5d4XxbmZKp6cHLZwB5+pe8yT4ZySe9H/QscJ5ldjw==',key_name='tempest-keypair-1104148254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-3xvux490',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:15:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=9bfaa36f-2822-47de-8d12-823e38b4aae4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:9a:fb,bridge_name='br-int',has_traffic_filtering=True,id=b77ab60c-66e8-4d0e-998d-86d6053a465d,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77ab60c-66') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG os_vif [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:9a:fb,bridge_name='br-int',has_traffic_filtering=True,id=b77ab60c-66e8-4d0e-998d-86d6053a465d,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77ab60c-66') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb77ab60c-66, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb77ab60c-66, col_values=(('external_ids', {'iface-id': 'b77ab60c-66e8-4d0e-998d-86d6053a465d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:9a:fb', 'vm-uuid': '9bfaa36f-2822-47de-8d12-823e38b4aae4'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:15:59 user nova-compute[73121]: INFO os_vif [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:9a:fb,bridge_name='br-int',has_traffic_filtering=True,id=b77ab60c-66e8-4d0e-998d-86d6053a465d,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77ab60c-66')
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:15:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No VIF found with MAC fa:16:3e:7a:9a:fb, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:16:00 user nova-compute[73121]: DEBUG nova.network.neutron [req-c78e0447-016d-42ad-92c1-0068198e14b5 req-7c2d45f6-0d83-4ec1-a737-09ae6522da43 service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Updated VIF entry in instance network info cache for port b77ab60c-66e8-4d0e-998d-86d6053a465d. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:16:00 user nova-compute[73121]: DEBUG nova.network.neutron [req-c78e0447-016d-42ad-92c1-0068198e14b5 req-7c2d45f6-0d83-4ec1-a737-09ae6522da43 service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Updating instance_info_cache with network_info: [{"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:16:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c78e0447-016d-42ad-92c1-0068198e14b5 req-7c2d45f6-0d83-4ec1-a737-09ae6522da43 service nova] Releasing lock "refresh_cache-9bfaa36f-2822-47de-8d12-823e38b4aae4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-4b459d39-f629-4108-a65e-3e2f7c3c5d7a req-59ae96d9-efdf-47e8-86cc-9653efb26b4b service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received event network-vif-plugged-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4b459d39-f629-4108-a65e-3e2f7c3c5d7a req-59ae96d9-efdf-47e8-86cc-9653efb26b4b service nova] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4b459d39-f629-4108-a65e-3e2f7c3c5d7a req-59ae96d9-efdf-47e8-86cc-9653efb26b4b service nova] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4b459d39-f629-4108-a65e-3e2f7c3c5d7a req-59ae96d9-efdf-47e8-86cc-9653efb26b4b service nova] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-4b459d39-f629-4108-a65e-3e2f7c3c5d7a req-59ae96d9-efdf-47e8-86cc-9653efb26b4b service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] No waiting events found dispatching network-vif-plugged-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:16:01 user nova-compute[73121]: WARNING nova.compute.manager [req-4b459d39-f629-4108-a65e-3e2f7c3c5d7a req-59ae96d9-efdf-47e8-86cc-9653efb26b4b service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received unexpected event network-vif-plugged-b77ab60c-66e8-4d0e-998d-86d6053a465d for instance with vm_state building and task_state spawning.
Aug 15 02:16:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065763.3671246, 9bfaa36f-2822-47de-8d12-823e38b4aae4 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:16:03 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] VM Resumed (Lifecycle Event)
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:16:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Instance spawned successfully.
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-6ed9fd41-3534-4c94-8276-15d31c38fa7a req-50428fe2-31f5-4183-b610-8cb726a96b9d service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received event network-vif-plugged-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ed9fd41-3534-4c94-8276-15d31c38fa7a req-50428fe2-31f5-4183-b610-8cb726a96b9d service nova] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ed9fd41-3534-4c94-8276-15d31c38fa7a req-50428fe2-31f5-4183-b610-8cb726a96b9d service nova] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ed9fd41-3534-4c94-8276-15d31c38fa7a req-50428fe2-31f5-4183-b610-8cb726a96b9d service nova] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-6ed9fd41-3534-4c94-8276-15d31c38fa7a req-50428fe2-31f5-4183-b610-8cb726a96b9d service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] No waiting events found dispatching network-vif-plugged-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:16:03 user nova-compute[73121]: WARNING nova.compute.manager [req-6ed9fd41-3534-4c94-8276-15d31c38fa7a req-50428fe2-31f5-4183-b610-8cb726a96b9d service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received unexpected event network-vif-plugged-b77ab60c-66e8-4d0e-998d-86d6053a465d for instance with vm_state building and task_state spawning.
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:16:03 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065763.5274906, 9bfaa36f-2822-47de-8d12-823e38b4aae4 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:16:03 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] VM Started (Lifecycle Event)
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:16:03 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:16:03 user nova-compute[73121]: INFO nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Took 6.73 seconds to spawn the instance on the hypervisor.
Aug 15 02:16:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:16:03 user nova-compute[73121]: INFO nova.compute.manager [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Took 7.47 seconds to build instance.
Aug 15 02:16:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-eb9f4bde-2ca4-4145-8207-cdcacc30ff08 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.576s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "00d2c851-39b9-40cb-8bac-785c954800cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "00d2c851-39b9-40cb-8bac-785c954800cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:08 user nova-compute[73121]: INFO nova.compute.manager [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Terminating instance
Aug 15 02:16:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-ee16575c-7dbb-4a93-90fc-457f8efae4a0 req-b7cf6537-53c6-4c6d-aa49-4f8a43b3adec service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received event network-vif-unplugged-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ee16575c-7dbb-4a93-90fc-457f8efae4a0 req-b7cf6537-53c6-4c6d-aa49-4f8a43b3adec service nova] Acquiring lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ee16575c-7dbb-4a93-90fc-457f8efae4a0 req-b7cf6537-53c6-4c6d-aa49-4f8a43b3adec service nova] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ee16575c-7dbb-4a93-90fc-457f8efae4a0 req-b7cf6537-53c6-4c6d-aa49-4f8a43b3adec service nova] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-ee16575c-7dbb-4a93-90fc-457f8efae4a0 req-b7cf6537-53c6-4c6d-aa49-4f8a43b3adec service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] No waiting events found dispatching network-vif-unplugged-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:16:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-ee16575c-7dbb-4a93-90fc-457f8efae4a0 req-b7cf6537-53c6-4c6d-aa49-4f8a43b3adec service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received event network-vif-unplugged-6cbc95d3-e345-4927-9abb-8e38f739af02 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:16:08 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Instance destroyed successfully.
Aug 15 02:16:08 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'resources' on Instance uuid 00d2c851-39b9-40cb-8bac-785c954800cf {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2018312012',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2018312012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2018312012',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu/Blf1ddUEbks9bFxw4NGiWdDO9HPgJuQqYFarETOfQleO0IMFyhlOTjO73jNrcuK/zZK37PWVq2aMOi2BUDTDtxraI/ivXZs1TarLJ8DvRVF86YqMBu5b/imirGzLPQ==',key_name='tempest-keypair-472124211',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-73cni1of',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:11:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=00d2c851-39b9-40cb-8bac-785c954800cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "6cbc95d3-e345-4927-9abb-8e38f739af02", "address": "fa:16:3e:a9:13:35", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cbc95d3-e3", "ovs_interfaceid": "6cbc95d3-e345-4927-9abb-8e38f739af02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:13:35,bridge_name='br-int',has_traffic_filtering=True,id=6cbc95d3-e345-4927-9abb-8e38f739af02,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc95d3-e3') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_vif [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:13:35,bridge_name='br-int',has_traffic_filtering=True,id=6cbc95d3-e345-4927-9abb-8e38f739af02,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc95d3-e3') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cbc95d3-e3, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:16:09 user nova-compute[73121]: INFO os_vif [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:13:35,bridge_name='br-int',has_traffic_filtering=True,id=6cbc95d3-e345-4927-9abb-8e38f739af02,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cbc95d3-e3')
Aug 15 02:16:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rWNwGVjH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:16:09 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ea46e8-2e36-42ee-9890-ceae7b538f0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[86021e71-5616-4a7c-a6ca-2c9020a5e2e8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:16:09 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:16:09 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:16:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:16:09 user nova-compute[73121]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 (non-flash)
Aug 15 02:16:09 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:16:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e207892d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e5c647-4d45-4ab4-badd-d5b869a1c777]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[946aa493-4100-49e9-b450-da1b84efcfc8]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9d32b8-5f51-4a1d-ba8c-42f982e77fbb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0c9351-057f-4e3f-8063-d8050f572b5f]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85207fa-d6f9-4d51-90e4-4cbc51014544]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[817a5ece-d802-4c49-98ff-b8e6956907f7]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757, portal: 172.16.0.220,3260]
Aug 15 02:16:09 user nova-compute[73121]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757, portal: 172.16.0.220,3260] successful.
Aug 15 02:16:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71530332-680c-4ff4-989e-f81f0f1b9757 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[63991c08-a26f-489b-aeae-7fd00121cc3c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== disconnect_volume: return (331ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:16:09 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Deleting instance files /opt/stack/data/nova/instances/00d2c851-39b9-40cb-8bac-785c954800cf_del
Aug 15 02:16:09 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Deletion of /opt/stack/data/nova/instances/00d2c851-39b9-40cb-8bac-785c954800cf_del complete
Aug 15 02:16:09 user nova-compute[73121]: INFO nova.compute.manager [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 15 02:16:09 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:16:09 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:16:10 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:16:10 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Took 0.89 seconds to deallocate network for instance.
Aug 15 02:16:10 user nova-compute[73121]: DEBUG nova.compute.manager [req-c1b0efd4-b97e-40d2-9b39-d34480670e8d req-33c55ba4-7fb1-4bfb-b522-9f5b5e5ca7b2 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received event network-vif-deleted-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:10 user nova-compute[73121]: INFO nova.compute.manager [req-c1b0efd4-b97e-40d2-9b39-d34480670e8d req-33c55ba4-7fb1-4bfb-b522-9f5b5e5ca7b2 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Neutron deleted interface 6cbc95d3-e345-4927-9abb-8e38f739af02; detaching it from the instance and deleting it from the info cache
Aug 15 02:16:10 user nova-compute[73121]: DEBUG nova.network.neutron [req-c1b0efd4-b97e-40d2-9b39-d34480670e8d req-33c55ba4-7fb1-4bfb-b522-9f5b5e5ca7b2 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:16:10 user nova-compute[73121]: DEBUG nova.compute.manager [req-c1b0efd4-b97e-40d2-9b39-d34480670e8d req-33c55ba4-7fb1-4bfb-b522-9f5b5e5ca7b2 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Detach interface failed, port_id=6cbc95d3-e345-4927-9abb-8e38f739af02, reason: Instance 00d2c851-39b9-40cb-8bac-785c954800cf could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:16:10 user nova-compute[73121]: DEBUG nova.compute.manager [req-0df557cd-c519-4120-8be5-b6c08cd7b340 req-3bc2c60e-5dad-412a-bf85-b7d04e441721 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received event network-vif-plugged-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0df557cd-c519-4120-8be5-b6c08cd7b340 req-3bc2c60e-5dad-412a-bf85-b7d04e441721 service nova] Acquiring lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0df557cd-c519-4120-8be5-b6c08cd7b340 req-3bc2c60e-5dad-412a-bf85-b7d04e441721 service nova] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0df557cd-c519-4120-8be5-b6c08cd7b340 req-3bc2c60e-5dad-412a-bf85-b7d04e441721 service nova] Lock "00d2c851-39b9-40cb-8bac-785c954800cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:10 user nova-compute[73121]: DEBUG nova.compute.manager [req-0df557cd-c519-4120-8be5-b6c08cd7b340 req-3bc2c60e-5dad-412a-bf85-b7d04e441721 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] No waiting events found dispatching network-vif-plugged-6cbc95d3-e345-4927-9abb-8e38f739af02 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:16:10 user nova-compute[73121]: WARNING nova.compute.manager [req-0df557cd-c519-4120-8be5-b6c08cd7b340 req-3bc2c60e-5dad-412a-bf85-b7d04e441721 service nova] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Received unexpected event network-vif-plugged-6cbc95d3-e345-4927-9abb-8e38f739af02 for instance with vm_state active and task_state deleting.
Aug 15 02:16:11 user nova-compute[73121]: INFO nova.compute.manager [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Took 0.82 seconds to detach 1 volumes for instance.
Aug 15 02:16:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Deleting volume: 71530332-680c-4ff4-989e-f81f0f1b9757 {{(pid=73121) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 02:16:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:11 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:16:11 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:16:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:11 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Deleted allocations for instance 00d2c851-39b9-40cb-8bac-785c954800cf
Aug 15 02:16:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b8275d41-2ee4-4167-947d-4aad3c108e5c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "00d2c851-39b9-40cb-8bac-785c954800cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.553s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:21 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:16:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:22 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:23 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065768.9769092, 00d2c851-39b9-40cb-8bac-785c954800cf => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:16:23 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] VM Stopped (Lifecycle Event)
Aug 15 02:16:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e60d658e-8f54-4632-bbfa-7729714e5636 None None] [instance: 00d2c851-39b9-40cb-8bac-785c954800cf] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:16:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:26 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:16:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-d7950f28-0893-49de-a560-bbc0791492b5" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:16:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-d7950f28-0893-49de-a560-bbc0791492b5" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:16:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:16:26 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Updating instance_info_cache with network_info: [{"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:16:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-d7950f28-0893-49de-a560-bbc0791492b5" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:16:26 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:16:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:28 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:16:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:16:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7215MB free_disk=25.123573303222656GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7950f28-0893-49de-a560-bbc0791492b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance afb831b1-b2b9-4771-a759-47fbaa2a0382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance bc351c09-798d-4048-b80f-0dbf85344edb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d5b2095f-df4e-4420-9dca-4552b10e3f3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1145ac04-f2f8-49d3-a54e-365f7269d8be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 9bfaa36f-2822-47de-8d12-823e38b4aae4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.752s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:16:34 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:16:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:16:42 user nova-compute[73121]: INFO nova.compute.claims [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Claim successful on node user
Aug 15 02:16:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:16:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:16:42 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:16:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG nova.policy [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6321528a357e45878a851a10e78226a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203875f0947a423faf1ae9930f401026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:16:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Creating image(s)
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk 1073741824" returned: 0 in 0.064s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Successfully created port: a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Cannot resize image /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'migration_context' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Ensure instance console log exists: /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Successfully updated port: a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquired lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-2a708c3a-8d0d-4a75-adce-6b721a36b311 req-3d8b9c0d-fe37-41a7-b972-03fd8c31b62a service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-changed-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-2a708c3a-8d0d-4a75-adce-6b721a36b311 req-3d8b9c0d-fe37-41a7-b972-03fd8c31b62a service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Refreshing instance network info cache due to event network-changed-a6084f1b-a315-4de8-a572-5cf33a871c66. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2a708c3a-8d0d-4a75-adce-6b721a36b311 req-3d8b9c0d-fe37-41a7-b972-03fd8c31b62a service nova] Acquiring lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating instance_info_cache with network_info: [{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Releasing lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance network_info: |[{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2a708c3a-8d0d-4a75-adce-6b721a36b311 req-3d8b9c0d-fe37-41a7-b972-03fd8c31b62a service nova] Acquired lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-2a708c3a-8d0d-4a75-adce-6b721a36b311 req-3d8b9c0d-fe37-41a7-b972-03fd8c31b62a service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Refreshing network info cache for port a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Start _get_guest_xml network_info=[{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:16:44 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:16:44 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-999784560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-999784560',id=36,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+vKc3yQUIiUeKk+6SqAfOnm7qoBAZhutX2WfEyQ8T7/hQuhg0kOVlZkj8Jg8z3zk8TDB4cIPXK1r6sq0Pvl9/gFMUh98L6bG9QYSc/d2ypUPKtISfwLWz1D/q+9IoS4g==',key_name='tempest-keypair-307324577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-4snqcx1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'pci_devices' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:16:44 user nova-compute[73121]:   <uuid>62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7</uuid>
Aug 15 02:16:44 user nova-compute[73121]:   <name>instance-00000024</name>
Aug 15 02:16:44 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:16:44 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:16:44 user nova-compute[73121]:   <metadata>
Aug 15 02:16:44 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:16:44 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:16:44 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-999784560</nova:name>
Aug 15 02:16:44 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:16:44</nova:creationTime>
Aug 15 02:16:44 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:16:44 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:16:44 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:16:44 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:16:44 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:16:44 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:16:44 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:16:44 user nova-compute[73121]:       <nova:owner>
Aug 15 02:16:44 user nova-compute[73121]:         <nova:user uuid="6321528a357e45878a851a10e78226a4">tempest-AttachVolumeShelveTestJSON-201192507-project-member</nova:user>
Aug 15 02:16:44 user nova-compute[73121]:         <nova:project uuid="203875f0947a423faf1ae9930f401026">tempest-AttachVolumeShelveTestJSON-201192507</nova:project>
Aug 15 02:16:44 user nova-compute[73121]:       </nova:owner>
Aug 15 02:16:44 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:16:44 user nova-compute[73121]:       <nova:ports>
Aug 15 02:16:44 user nova-compute[73121]:         <nova:port uuid="a6084f1b-a315-4de8-a572-5cf33a871c66">
Aug 15 02:16:44 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:16:44 user nova-compute[73121]:         </nova:port>
Aug 15 02:16:44 user nova-compute[73121]:       </nova:ports>
Aug 15 02:16:44 user nova-compute[73121]:     </nova:instance>
Aug 15 02:16:44 user nova-compute[73121]:   </metadata>
Aug 15 02:16:44 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:16:44 user nova-compute[73121]:     <system>
Aug 15 02:16:44 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:16:44 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:16:44 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:16:44 user nova-compute[73121]:       <entry name="serial">62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7</entry>
Aug 15 02:16:44 user nova-compute[73121]:       <entry name="uuid">62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7</entry>
Aug 15 02:16:44 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:16:44 user nova-compute[73121]:     </system>
Aug 15 02:16:44 user nova-compute[73121]:   </sysinfo>
Aug 15 02:16:44 user nova-compute[73121]:   <os>
Aug 15 02:16:44 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:16:44 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:16:44 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:16:44 user nova-compute[73121]:   </os>
Aug 15 02:16:44 user nova-compute[73121]:   <features>
Aug 15 02:16:44 user nova-compute[73121]:     <acpi/>
Aug 15 02:16:44 user nova-compute[73121]:     <apic/>
Aug 15 02:16:44 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:16:44 user nova-compute[73121]:   </features>
Aug 15 02:16:44 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:16:44 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:16:44 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:16:44 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:16:44 user nova-compute[73121]:   </clock>
Aug 15 02:16:44 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:16:44 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:16:44 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:16:44 user nova-compute[73121]:   </cpu>
Aug 15 02:16:44 user nova-compute[73121]:   <devices>
Aug 15 02:16:44 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:16:44 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:16:44 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk"/>
Aug 15 02:16:44 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:16:44 user nova-compute[73121]:     </disk>
Aug 15 02:16:44 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:16:44 user nova-compute[73121]:       <mac address="fa:16:3e:d0:4e:de"/>
Aug 15 02:16:44 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:16:44 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:16:44 user nova-compute[73121]:       <target dev="tapa6084f1b-a3"/>
Aug 15 02:16:44 user nova-compute[73121]:     </interface>
Aug 15 02:16:44 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:16:44 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/console.log" append="off"/>
Aug 15 02:16:44 user nova-compute[73121]:     </serial>
Aug 15 02:16:44 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:16:44 user nova-compute[73121]:     <video>
Aug 15 02:16:44 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:16:44 user nova-compute[73121]:     </video>
Aug 15 02:16:44 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:16:44 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:16:44 user nova-compute[73121]:     </rng>
Aug 15 02:16:44 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:16:44 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:16:44 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:16:44 user nova-compute[73121]:     </memballoon>
Aug 15 02:16:44 user nova-compute[73121]:   </devices>
Aug 15 02:16:44 user nova-compute[73121]: </domain>
Aug 15 02:16:44 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-999784560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-999784560',id=36,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+vKc3yQUIiUeKk+6SqAfOnm7qoBAZhutX2WfEyQ8T7/hQuhg0kOVlZkj8Jg8z3zk8TDB4cIPXK1r6sq0Pvl9/gFMUh98L6bG9QYSc/d2ypUPKtISfwLWz1D/q+9IoS4g==',key_name='tempest-keypair-307324577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-4snqcx1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG os_vif [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6084f1b-a3, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6084f1b-a3, col_values=(('external_ids', {'iface-id': 'a6084f1b-a315-4de8-a572-5cf33a871c66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:4e:de', 'vm-uuid': '62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:16:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:44 user nova-compute[73121]: INFO os_vif [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3')
Aug 15 02:16:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] No VIF found with MAC fa:16:3e:d0:4e:de, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:45 user nova-compute[73121]: INFO nova.compute.manager [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Terminating instance
Aug 15 02:16:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-ce69c480-4e33-4427-87fe-8a6dd46c4044 req-c19b0b71-aa71-4e3c-9aa7-5a2530afdb26 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-unplugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ce69c480-4e33-4427-87fe-8a6dd46c4044 req-c19b0b71-aa71-4e3c-9aa7-5a2530afdb26 service nova] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ce69c480-4e33-4427-87fe-8a6dd46c4044 req-c19b0b71-aa71-4e3c-9aa7-5a2530afdb26 service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ce69c480-4e33-4427-87fe-8a6dd46c4044 req-c19b0b71-aa71-4e3c-9aa7-5a2530afdb26 service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-ce69c480-4e33-4427-87fe-8a6dd46c4044 req-c19b0b71-aa71-4e3c-9aa7-5a2530afdb26 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] No waiting events found dispatching network-vif-unplugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-ce69c480-4e33-4427-87fe-8a6dd46c4044 req-c19b0b71-aa71-4e3c-9aa7-5a2530afdb26 service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-unplugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG nova.network.neutron [req-2a708c3a-8d0d-4a75-adce-6b721a36b311 req-3d8b9c0d-fe37-41a7-b972-03fd8c31b62a service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updated VIF entry in instance network info cache for port a6084f1b-a315-4de8-a572-5cf33a871c66. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG nova.network.neutron [req-2a708c3a-8d0d-4a75-adce-6b721a36b311 req-3d8b9c0d-fe37-41a7-b972-03fd8c31b62a service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating instance_info_cache with network_info: [{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:16:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2a708c3a-8d0d-4a75-adce-6b721a36b311 req-3d8b9c0d-fe37-41a7-b972-03fd8c31b62a service nova] Releasing lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:16:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Instance destroyed successfully.
Aug 15 02:16:46 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'resources' on Instance uuid bc351c09-798d-4048-b80f-0dbf85344edb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-724694426',display_name='tempest-TestMinimumBasicScenario-server-724694426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-724694426',id=29,image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCv5wrOyrsFzl86DFGNOG2qdwU+l5stRjEuUFkXpORmxvzfKrk++1H0yJTS3sm8eXOfrl9ikhygtF+mYZYN2XmCBxEnWJzDHLcDUktCk2f1cZunA4iBo3k4IL4842am+Nw==',key_name='tempest-TestMinimumBasicScenario-2078449806',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:11:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3c8eef30d43d98388840e389efc24',ramdisk_id='',reservation_id='r-26nhe67r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='93d97bf5-b392-4cc3-b28f-86cb5a52e660',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2011934660',owner_user_name='tempest-TestMinimumBasicScenario-2011934660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:14:03Z,user_data=None,user_id='3992e0609efb4ad389253810ab9b0d33',uuid=bc351c09-798d-4048-b80f-0dbf85344edb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converting VIF {"id": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "address": "fa:16:3e:cb:f3:fa", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc315ab1b-2e", "ovs_interfaceid": "c315ab1b-2e05-4e8b-a995-849f3cb9249b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG os_vif [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc315ab1b-2e, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:46 user nova-compute[73121]: INFO os_vif [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:f3:fa,bridge_name='br-int',has_traffic_filtering=True,id=c315ab1b-2e05-4e8b-a995-849f3cb9249b,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc315ab1b-2e')
Aug 15 02:16:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Deleting instance files /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb_del
Aug 15 02:16:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Deletion of /opt/stack/data/nova/instances/bc351c09-798d-4048-b80f-0dbf85344edb_del complete
Aug 15 02:16:46 user nova-compute[73121]: INFO nova.compute.manager [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Took 1.59 seconds to destroy the instance on the hypervisor.
Aug 15 02:16:46 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-96b1c022-e2d8-40ba-a636-730d1f3673a8 req-f7132b72-ce09-4036-965e-8a7917d40985 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96b1c022-e2d8-40ba-a636-730d1f3673a8 req-f7132b72-ce09-4036-965e-8a7917d40985 service nova] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96b1c022-e2d8-40ba-a636-730d1f3673a8 req-f7132b72-ce09-4036-965e-8a7917d40985 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96b1c022-e2d8-40ba-a636-730d1f3673a8 req-f7132b72-ce09-4036-965e-8a7917d40985 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-96b1c022-e2d8-40ba-a636-730d1f3673a8 req-f7132b72-ce09-4036-965e-8a7917d40985 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] No waiting events found dispatching network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:16:46 user nova-compute[73121]: WARNING nova.compute.manager [req-96b1c022-e2d8-40ba-a636-730d1f3673a8 req-f7132b72-ce09-4036-965e-8a7917d40985 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received unexpected event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 for instance with vm_state building and task_state spawning.
Aug 15 02:16:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:16:47 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Took 0.72 seconds to deallocate network for instance.
Aug 15 02:16:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-389ef8d0-7309-4675-ab8d-1777f99d9bc2 req-264ad937-4fe0-4ef6-a380-a7078c8767bd service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-389ef8d0-7309-4675-ab8d-1777f99d9bc2 req-264ad937-4fe0-4ef6-a380-a7078c8767bd service nova] Acquiring lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-389ef8d0-7309-4675-ab8d-1777f99d9bc2 req-264ad937-4fe0-4ef6-a380-a7078c8767bd service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-389ef8d0-7309-4675-ab8d-1777f99d9bc2 req-264ad937-4fe0-4ef6-a380-a7078c8767bd service nova] Lock "bc351c09-798d-4048-b80f-0dbf85344edb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-389ef8d0-7309-4675-ab8d-1777f99d9bc2 req-264ad937-4fe0-4ef6-a380-a7078c8767bd service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] No waiting events found dispatching network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:16:47 user nova-compute[73121]: WARNING nova.compute.manager [req-389ef8d0-7309-4675-ab8d-1777f99d9bc2 req-264ad937-4fe0-4ef6-a380-a7078c8767bd service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received unexpected event network-vif-plugged-c315ab1b-2e05-4e8b-a995-849f3cb9249b for instance with vm_state active and task_state deleting.
Aug 15 02:16:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:16:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.364s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:47 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Deleted allocations for instance bc351c09-798d-4048-b80f-0dbf85344edb
Aug 15 02:16:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0a1dc1b8-0816-4135-9ad4-a35221e7ca00 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "bc351c09-798d-4048-b80f-0dbf85344edb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.867s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065808.906885, 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:16:48 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] VM Resumed (Lifecycle Event)
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:16:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance spawned successfully.
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-4e073a5d-fa62-4457-a54c-35886341c9fe req-c61eeba9-c236-416e-9ce8-2da02570eeeb service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4e073a5d-fa62-4457-a54c-35886341c9fe req-c61eeba9-c236-416e-9ce8-2da02570eeeb service nova] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4e073a5d-fa62-4457-a54c-35886341c9fe req-c61eeba9-c236-416e-9ce8-2da02570eeeb service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4e073a5d-fa62-4457-a54c-35886341c9fe req-c61eeba9-c236-416e-9ce8-2da02570eeeb service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-4e073a5d-fa62-4457-a54c-35886341c9fe req-c61eeba9-c236-416e-9ce8-2da02570eeeb service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] No waiting events found dispatching network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:16:48 user nova-compute[73121]: WARNING nova.compute.manager [req-4e073a5d-fa62-4457-a54c-35886341c9fe req-c61eeba9-c236-416e-9ce8-2da02570eeeb service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received unexpected event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 for instance with vm_state building and task_state spawning.
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-4e073a5d-fa62-4457-a54c-35886341c9fe req-c61eeba9-c236-416e-9ce8-2da02570eeeb service nova] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Received event network-vif-deleted-c315ab1b-2e05-4e8b-a995-849f3cb9249b {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:16:48 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:16:48 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065808.9082806, 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:16:48 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] VM Started (Lifecycle Event)
Aug 15 02:16:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:16:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:16:49 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:16:49 user nova-compute[73121]: INFO nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 15 02:16:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:16:49 user nova-compute[73121]: INFO nova.compute.manager [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Took 6.77 seconds to build instance.
Aug 15 02:16:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2d01e671-983a-4bee-8b43-a0a39ec624fc tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.909s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:16:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:16:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:01 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065806.5825894, bc351c09-798d-4048-b80f-0dbf85344edb => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:17:01 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] VM Stopped (Lifecycle Event)
Aug 15 02:17:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d14d14e2-702c-4b55-8cd9-ab29f216e792 None None] [instance: bc351c09-798d-4048-b80f-0dbf85344edb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:17:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:17:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:17:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:17:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:17:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:17:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:17:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:17:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:17:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:17:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid ad8b33e3-c58c-4182-a43a-248f5f1face1 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid d7950f28-0893-49de-a560-bbc0791492b5 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 2dd8fa27-d069-4e43-9789-34ec3ed2d371 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 9bfaa36f-2822-47de-8d12-823e38b4aae4 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "d7950f28-0893-49de-a560-bbc0791492b5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "d7950f28-0893-49de-a560-bbc0791492b5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "d7950f28-0893-49de-a560-bbc0791492b5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:10 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:17:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:10 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:17:10 user nova-compute[73121]: INFO nova.compute.claims [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Claim successful on node user
Aug 15 02:17:10 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:17:10 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:17:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:17:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:17:11 user nova-compute[73121]: INFO nova.virt.block_device [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Booting with volume a78d1dcd-f1cd-4805-bea8-79afa0919c27 at /dev/vda
Aug 15 02:17:11 user nova-compute[73121]: DEBUG nova.policy [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f22753e4f3934dddab87961c43c68fb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0739b6fd0a4c3097a1e0d329176a78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG os_brick.utils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fe1284-8f9d-4d29-996c-e858fe578e27]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4af87d-c985-4528-afaf-31f6b569333b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e963b7-b025-44e6-9b85-9e076552b46c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc120cd-fc1f-4f05-a8ac-8c74255e16f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:11 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511e147-14df-4463-a142-7e6d4ed8b271]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG os_brick.utils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating existing volume attachment record: ddc6b4ff-0961-408d-865b-963e5f137c0d {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "02572d81-b687-48ca-bb93-cedebe076fdf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "02572d81-b687-48ca-bb93-cedebe076fdf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:17:11 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Successfully created port: 7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:17:12 user nova-compute[73121]: INFO nova.compute.claims [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Claim successful on node user
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:17:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:17:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.policy [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f9c4f2ffebb440cb88132a502d51811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3397dd14ca44c19dc4386aec30a9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:17:12 user nova-compute[73121]: INFO nova.virt.block_device [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Booting with volume 8227d1ba-6670-4189-85dd-7d91a9409e5d at /dev/vda
Aug 15 02:17:12 user nova-compute[73121]: DEBUG os_brick.utils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Successfully updated port: 7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[164f8e1e-c39f-423c-8a0b-7fddc1ca9561]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquired lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0173c18-230e-49c1-ae19-64603ee509e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-a32e91fa-20c8-4e33-878e-b49d8c9479b0 req-7b8426cb-8a3f-42cd-b9a1-c8ea2cfe4e1c service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-changed-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-a32e91fa-20c8-4e33-878e-b49d8c9479b0 req-7b8426cb-8a3f-42cd-b9a1-c8ea2cfe4e1c service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Refreshing instance network info cache due to event network-changed-7c725b88-d99b-4290-b3e7-6152fb3432ee. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a32e91fa-20c8-4e33-878e-b49d8c9479b0 req-7b8426cb-8a3f-42cd-b9a1-c8ea2cfe4e1c service nova] Acquiring lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fb4fcc-7aec-495a-aaab-a65c194b532a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a4b1a7-e6c8-44b7-a615-e77dbe1a3c3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:17:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:13 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:17:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaba112-5999-4fea-9ab5-a10e19bb956c]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG os_brick.utils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Updating existing volume attachment record: 4605495d-525d-4056-be12-976a746abee7 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating instance_info_cache with network_info: [{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Releasing lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Instance network_info: |[{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a32e91fa-20c8-4e33-878e-b49d8c9479b0 req-7b8426cb-8a3f-42cd-b9a1-c8ea2cfe4e1c service nova] Acquired lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG nova.network.neutron [req-a32e91fa-20c8-4e33-878e-b49d8c9479b0 req-7b8426cb-8a3f-42cd-b9a1-c8ea2cfe4e1c service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Refreshing network info cache for port 7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Successfully created port: 297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG nova.network.neutron [req-a32e91fa-20c8-4e33-878e-b49d8c9479b0 req-7b8426cb-8a3f-42cd-b9a1-c8ea2cfe4e1c service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updated VIF entry in instance network info cache for port 7c725b88-d99b-4290-b3e7-6152fb3432ee. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG nova.network.neutron [req-a32e91fa-20c8-4e33-878e-b49d8c9479b0 req-7b8426cb-8a3f-42cd-b9a1-c8ea2cfe4e1c service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating instance_info_cache with network_info: [{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a32e91fa-20c8-4e33-878e-b49d8c9479b0 req-7b8426cb-8a3f-42cd-b9a1-c8ea2cfe4e1c service nova] Releasing lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-333a935f-d9fe-4712-b67d-b0351f0bbf3b req-98d08db4-7d81-4fb2-b657-7ba20dc75f07 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received event network-changed-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-333a935f-d9fe-4712-b67d-b0351f0bbf3b req-98d08db4-7d81-4fb2-b657-7ba20dc75f07 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Refreshing instance network info cache due to event network-changed-a1458fef-0602-4e19-8e52-c608a485e25f. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-333a935f-d9fe-4712-b67d-b0351f0bbf3b req-98d08db4-7d81-4fb2-b657-7ba20dc75f07 service nova] Acquiring lock "refresh_cache-2dd8fa27-d069-4e43-9789-34ec3ed2d371" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-333a935f-d9fe-4712-b67d-b0351f0bbf3b req-98d08db4-7d81-4fb2-b657-7ba20dc75f07 service nova] Acquired lock "refresh_cache-2dd8fa27-d069-4e43-9789-34ec3ed2d371" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.network.neutron [req-333a935f-d9fe-4712-b67d-b0351f0bbf3b req-98d08db4-7d81-4fb2-b657-7ba20dc75f07 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Refreshing network info cache for port a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Successfully updated port: 297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "refresh_cache-02572d81-b687-48ca-bb93-cedebe076fdf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquired lock "refresh_cache-02572d81-b687-48ca-bb93-cedebe076fdf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.objects.instance [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'flavor' on Instance uuid 2dd8fa27-d069-4e43-9789-34ec3ed2d371 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:15 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Ignoring supplied device name: /dev/vdb
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.network.neutron [req-333a935f-d9fe-4712-b67d-b0351f0bbf3b req-98d08db4-7d81-4fb2-b657-7ba20dc75f07 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Updated VIF entry in instance network info cache for port a1458fef-0602-4e19-8e52-c608a485e25f. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.network.neutron [req-333a935f-d9fe-4712-b67d-b0351f0bbf3b req-98d08db4-7d81-4fb2-b657-7ba20dc75f07 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Updating instance_info_cache with network_info: [{"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-333a935f-d9fe-4712-b67d-b0351f0bbf3b req-98d08db4-7d81-4fb2-b657-7ba20dc75f07 service nova] Releasing lock "refresh_cache-2dd8fa27-d069-4e43-9789-34ec3ed2d371" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:15 user nova-compute[73121]: INFO nova.compute.manager [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Attaching volume 5eba0910-dcc9-48bf-a566-4bee0d0caa13 to /dev/vdb
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.network.neutron [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Updating instance_info_cache with network_info: [{"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG os_brick.utils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Releasing lock "refresh_cache-02572d81-b687-48ca-bb93-cedebe076fdf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Instance network_info: |[{"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d75993-a053-4f6d-8c54-6e5e72a166b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[29295c0d-2c84-4f95-b9a9-246303c1c2f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a222ae24-a47c-4863-a149-5a513c822541]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69dd49a-18ad-41ed-93e7-1e60331d6faa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:15 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:17:15 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc92e9d3-74c0-43bd-a662-483ad1f614ac]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG os_brick.utils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:15 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Updating existing volume attachment record: 6956bece-3deb-4a79-835d-cc4adfcfc867 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:17:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:17 user nova-compute[73121]: DEBUG nova.compute.manager [req-b7bf8d72-71b2-46b1-92f4-8bfbcfae9e92 req-0532d11d-cae6-4da3-b012-082feee3f418 service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received event network-changed-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:17 user nova-compute[73121]: DEBUG nova.compute.manager [req-b7bf8d72-71b2-46b1-92f4-8bfbcfae9e92 req-0532d11d-cae6-4da3-b012-082feee3f418 service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Refreshing instance network info cache due to event network-changed-297d9181-5888-4728-8b38-39fbe97d0992. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:17:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b7bf8d72-71b2-46b1-92f4-8bfbcfae9e92 req-0532d11d-cae6-4da3-b012-082feee3f418 service nova] Acquiring lock "refresh_cache-02572d81-b687-48ca-bb93-cedebe076fdf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b7bf8d72-71b2-46b1-92f4-8bfbcfae9e92 req-0532d11d-cae6-4da3-b012-082feee3f418 service nova] Acquired lock "refresh_cache-02572d81-b687-48ca-bb93-cedebe076fdf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:17 user nova-compute[73121]: DEBUG nova.network.neutron [req-b7bf8d72-71b2-46b1-92f4-8bfbcfae9e92 req-0532d11d-cae6-4da3-b012-082feee3f418 service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Refreshing network info cache for port 297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:17:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:17 user nova-compute[73121]: DEBUG nova.network.neutron [req-b7bf8d72-71b2-46b1-92f4-8bfbcfae9e92 req-0532d11d-cae6-4da3-b012-082feee3f418 service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Updated VIF entry in instance network info cache for port 297d9181-5888-4728-8b38-39fbe97d0992. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:17:17 user nova-compute[73121]: DEBUG nova.network.neutron [req-b7bf8d72-71b2-46b1-92f4-8bfbcfae9e92 req-0532d11d-cae6-4da3-b012-082feee3f418 service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Updating instance_info_cache with network_info: [{"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b7bf8d72-71b2-46b1-92f4-8bfbcfae9e92 req-0532d11d-cae6-4da3-b012-082feee3f418 service nova] Releasing lock "refresh_cache-02572d81-b687-48ca-bb93-cedebe076fdf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:22 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:17:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Creating image(s)
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Ensure instance console log exists: /opt/stack/data/nova/instances/454e5897-0179-41fb-a58d-c264831ee4a9/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Start _get_guest_xml network_info=[{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ddc6b4ff-0961-408d-865b-963e5f137c0d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdtmejLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '454e5897-0179-41fb-a58d-c264831ee4a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'a78d1dcd-f1cd-4805-bea8-79afa0919c27', 'serial': 'a78d1dcd-f1cd-4805-bea8-79afa0919c27'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:17:23 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:17:23 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdtmejLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:23 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:17:23 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:17:23 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b773d2d-07df-4141-86dd-c1f9c387599f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:17:23 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae7d6c3-253b-4ee1-9749-fc4a65f7c5ba]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27] added
Aug 15 02:17:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e157d55-b610-43c8-b976-b09a5ab04417]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe147b6-42dc-4d35-b4fc-1dd02ab2ba5b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdtmejLg {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdtmejLg" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7419c48f-8acd-4b87-a3ec-641e1d9bd76e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UdtmejLg'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d445067-6493-450b-a3c5-8053f857c560]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15f1d05-fdb7-4014-b33d-cba0eb5009c0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb51881-1c56-494d-add9-876baa4b5667]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260]
Aug 15 02:17:23 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260] successful.
Aug 15 02:17:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2ce445-7588-4697-bd8b-809be93c9f4f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[118713ea-f918-4450-b437-52bcbd0b2e85]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[607e5584-cc2f-4873-a969-1924d7756eac]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:17:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdtmejLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMgWyfCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:24 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:17:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:24 user nova-compute[73121]: INFO nova.compute.manager [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Terminating instance
Aug 15 02:17:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23732383033636238', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732383033636238', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.119s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:17:24 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:17:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:17:24 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:17:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2101332850',display_name='tempest-ServerActionsTestOtherA-server-2101332850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2101332850',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdD9feBUtKJxWabCOxeEfVUYblkUx99maantL29ickzkNiSka7JcOd7LAkLzENREY7q67OdhUq5n4xklCuCa82bJF6NH8tngV7k73jmjSgmnNbURsM8zWbxOgcKQEI/Q==',key_name='tempest-keypair-556442797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-1c2cui6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=454e5897-0179-41fb-a58d-c264831ee4a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'pci_devices' on Instance uuid 454e5897-0179-41fb-a58d-c264831ee4a9 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6dea63-cf47-4e16-ac42-fee454d1858e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:17:24 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:17:25 user nova-compute[73121]:   <uuid>454e5897-0179-41fb-a58d-c264831ee4a9</uuid>
Aug 15 02:17:25 user nova-compute[73121]:   <name>instance-00000025</name>
Aug 15 02:17:25 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:17:25 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:17:25 user nova-compute[73121]:   <metadata>
Aug 15 02:17:25 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:17:25 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:17:25 user nova-compute[73121]:       <nova:name>tempest-ServerActionsTestOtherA-server-2101332850</nova:name>
Aug 15 02:17:25 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:17:23</nova:creationTime>
Aug 15 02:17:25 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:17:25 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:17:25 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:17:25 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:17:25 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:17:25 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:17:25 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:17:25 user nova-compute[73121]:       <nova:owner>
Aug 15 02:17:25 user nova-compute[73121]:         <nova:user uuid="f22753e4f3934dddab87961c43c68fb2">tempest-ServerActionsTestOtherA-148244694-project-member</nova:user>
Aug 15 02:17:25 user nova-compute[73121]:         <nova:project uuid="fb0739b6fd0a4c3097a1e0d329176a78">tempest-ServerActionsTestOtherA-148244694</nova:project>
Aug 15 02:17:25 user nova-compute[73121]:       </nova:owner>
Aug 15 02:17:25 user nova-compute[73121]:       <nova:ports>
Aug 15 02:17:25 user nova-compute[73121]:         <nova:port uuid="7c725b88-d99b-4290-b3e7-6152fb3432ee">
Aug 15 02:17:25 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 02:17:25 user nova-compute[73121]:         </nova:port>
Aug 15 02:17:25 user nova-compute[73121]:       </nova:ports>
Aug 15 02:17:25 user nova-compute[73121]:     </nova:instance>
Aug 15 02:17:25 user nova-compute[73121]:   </metadata>
Aug 15 02:17:25 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:17:25 user nova-compute[73121]:     <system>
Aug 15 02:17:25 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:17:25 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:17:25 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:17:25 user nova-compute[73121]:       <entry name="serial">454e5897-0179-41fb-a58d-c264831ee4a9</entry>
Aug 15 02:17:25 user nova-compute[73121]:       <entry name="uuid">454e5897-0179-41fb-a58d-c264831ee4a9</entry>
Aug 15 02:17:25 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:17:25 user nova-compute[73121]:     </system>
Aug 15 02:17:25 user nova-compute[73121]:   </sysinfo>
Aug 15 02:17:25 user nova-compute[73121]:   <os>
Aug 15 02:17:25 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:17:25 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:17:25 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:17:25 user nova-compute[73121]:   </os>
Aug 15 02:17:25 user nova-compute[73121]:   <features>
Aug 15 02:17:25 user nova-compute[73121]:     <acpi/>
Aug 15 02:17:25 user nova-compute[73121]:     <apic/>
Aug 15 02:17:25 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:17:25 user nova-compute[73121]:   </features>
Aug 15 02:17:25 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:17:25 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:17:25 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:17:25 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:17:25 user nova-compute[73121]:   </clock>
Aug 15 02:17:25 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:17:25 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:17:25 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:17:25 user nova-compute[73121]:   </cpu>
Aug 15 02:17:25 user nova-compute[73121]:   <devices>
Aug 15 02:17:25 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:17:25 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:17:25 user nova-compute[73121]:       <source dev="/dev/sdc"/>
Aug 15 02:17:25 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:17:25 user nova-compute[73121]:       <serial>a78d1dcd-f1cd-4805-bea8-79afa0919c27</serial>
Aug 15 02:17:25 user nova-compute[73121]:     </disk>
Aug 15 02:17:25 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:17:25 user nova-compute[73121]:       <mac address="fa:16:3e:b8:12:7a"/>
Aug 15 02:17:25 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:17:25 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:17:25 user nova-compute[73121]:       <target dev="tap7c725b88-d9"/>
Aug 15 02:17:25 user nova-compute[73121]:     </interface>
Aug 15 02:17:25 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:17:25 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/454e5897-0179-41fb-a58d-c264831ee4a9/console.log" append="off"/>
Aug 15 02:17:25 user nova-compute[73121]:     </serial>
Aug 15 02:17:25 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:17:25 user nova-compute[73121]:     <video>
Aug 15 02:17:25 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:17:25 user nova-compute[73121]:     </video>
Aug 15 02:17:25 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:17:25 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:17:25 user nova-compute[73121]:     </rng>
Aug 15 02:17:25 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:17:25 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:17:25 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:17:25 user nova-compute[73121]:     </memballoon>
Aug 15 02:17:25 user nova-compute[73121]:   </devices>
Aug 15 02:17:25 user nova-compute[73121]: </domain>
Aug 15 02:17:25 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2101332850',display_name='tempest-ServerActionsTestOtherA-server-2101332850',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2101332850',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdD9feBUtKJxWabCOxeEfVUYblkUx99maantL29ickzkNiSka7JcOd7LAkLzENREY7q67OdhUq5n4xklCuCa82bJF6NH8tngV7k73jmjSgmnNbURsM8zWbxOgcKQEI/Q==',key_name='tempest-keypair-556442797',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-1c2cui6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=454e5897-0179-41fb-a58d-c264831ee4a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_vif [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb58bd2b-50cc-49d9-8a3b-9088b6433c8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13] added
Aug 15 02:17:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c725b88-d9, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c725b88-d9, col_values=(('external_ids', {'iface-id': '7c725b88-d99b-4290-b3e7-6152fb3432ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:12:7a', 'vm-uuid': '454e5897-0179-41fb-a58d-c264831ee4a9'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cced68-2600-4bfe-862f-5b38bbcce604]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:25 user nova-compute[73121]: INFO os_vif [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9')
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb79cee-8b6d-465e-8832-61d39ea56005]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KMgWyfCl {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KMgWyfCl" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a992fcc-9e64-4491-9546-7467c34fbc8e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KMgWyfCl'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[100af587-06e7-48de-8f67-64d1df0955fd]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No VIF found with MAC fa:16:3e:b8:12:7a, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2cc236-35e7-4b89-b7d6-f657db1b45e4]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-99365a81-b6e1-4f88-9b39-d66cc9d3660c req-1357f1e9-8cdc-44e5-8f4a-4a32c104e4da service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-unplugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-99365a81-b6e1-4f88-9b39-d66cc9d3660c req-1357f1e9-8cdc-44e5-8f4a-4a32c104e4da service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-99365a81-b6e1-4f88-9b39-d66cc9d3660c req-1357f1e9-8cdc-44e5-8f4a-4a32c104e4da service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-99365a81-b6e1-4f88-9b39-d66cc9d3660c req-1357f1e9-8cdc-44e5-8f4a-4a32c104e4da service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-99365a81-b6e1-4f88-9b39-d66cc9d3660c req-1357f1e9-8cdc-44e5-8f4a-4a32c104e4da service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-unplugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-99365a81-b6e1-4f88-9b39-d66cc9d3660c req-1357f1e9-8cdc-44e5-8f4a-4a32c104e4da service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-unplugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[714df682-401d-47ff-aa53-53e302997dcd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13, portal: 172.16.0.220,3260]
Aug 15 02:17:25 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13, portal: 172.16.0.220,3260] successful.
Aug 15 02:17:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[31beffa9-aab3-42dc-9343-5ca9536e2bbf]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae481313-5bbe-4c20-971b-cd9f32d3294c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:25 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.366s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eea1ca6-820b-433f-8bdf-84105d9577df]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:17:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMgWyfCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Instance destroyed successfully.
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'resources' on Instance uuid d5b2095f-df4e-4420-9dca-4552b10e3f3e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:11:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1940753038',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1940753038',id=30,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-1mrd2u0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:15:39Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=d5b2095f-df4e-4420-9dca-4552b10e3f3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "address": "fa:16:3e:25:46:79", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc423ec03-ba", "ovs_interfaceid": "c423ec03-ba94-4691-bcc1-b7354e3b1a80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:46:79,bridge_name='br-int',has_traffic_filtering=True,id=c423ec03-ba94-4691-bcc1-b7354e3b1a80,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc423ec03-ba') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_vif [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:46:79,bridge_name='br-int',has_traffic_filtering=True,id=c423ec03-ba94-4691-bcc1-b7354e3b1a80,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc423ec03-ba') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc423ec03-ba, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:26 user nova-compute[73121]: INFO os_vif [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:46:79,bridge_name='br-int',has_traffic_filtering=True,id=c423ec03-ba94-4691-bcc1-b7354e3b1a80,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc423ec03-ba')
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IqOGJcwW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:26 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.411s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '23564656531306333', 'path': '/dev/sdd'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564656531306333', 'path': '/dev/sdd'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.168s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'flavor' on Instance uuid 2dd8fa27-d069-4e43-9789-34ec3ed2d371 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a93d6d6-6fb0-48ea-9c9e-f9f54aba8576]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:17:26 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:17:26 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:17:26 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:17:26 user nova-compute[73121]:   <serial>5eba0910-dcc9-48bf-a566-4bee0d0caa13</serial>
Aug 15 02:17:26 user nova-compute[73121]: </disk>
Aug 15 02:17:26 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfb610c-6a54-4327-bdf9-96231e1d1ad0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:26 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:26 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:26 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:26 user nova-compute[73121]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 (non-flash)
Aug 15 02:17:26 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:26 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc638d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086'): ({'sdg'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Removing single pathed devices sdg {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[54700ae9-dc93-4df8-a502-b28e46156845]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[30223385-e16b-4502-89be-9a745431068c]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flushing IO for device /dev/sdg {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c9b78-2190-425b-99c0-77a7aade2bbe]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.041s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cae5650-8ad0-44aa-8179-2190a7044d66]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] SCSI volumes sdg have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2c3d71-b86f-4dcb-8de5-8f6d3e98f8b1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f9fbfe-103d-40c0-b11e-3a3b79f48afe]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086, portal: 172.16.0.220,3260]
Aug 15 02:17:26 user nova-compute[73121]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086, portal: 172.16.0.220,3260] successful.
Aug 15 02:17:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e0936d-0dff-4421-a3a9-dd2194e9d086 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[92643b8b-8a80-4d2a-a571-fadd209e0019]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] <== disconnect_volume: return (481ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:17:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Deleting instance files /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e_del
Aug 15 02:17:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Deletion of /opt/stack/data/nova/instances/d5b2095f-df4e-4420-9dca-4552b10e3f3e_del complete
Aug 15 02:17:26 user nova-compute[73121]: INFO nova.compute.manager [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Took 1.85 seconds to destroy the instance on the hypervisor.
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No VIF found with MAC fa:16:3e:15:b1:68, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:17:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-aa05dbf8-5f61-412f-86dc-732d621f2d73 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.317s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccc0fc69-f5c5-43af-b813-2d720d2981a4 req-680ead1a-583e-4231-a34a-befbece77c4e service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccc0fc69-f5c5-43af-b813-2d720d2981a4 req-680ead1a-583e-4231-a34a-befbece77c4e service nova] Acquiring lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccc0fc69-f5c5-43af-b813-2d720d2981a4 req-680ead1a-583e-4231-a34a-befbece77c4e service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccc0fc69-f5c5-43af-b813-2d720d2981a4 req-680ead1a-583e-4231-a34a-befbece77c4e service nova] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccc0fc69-f5c5-43af-b813-2d720d2981a4 req-680ead1a-583e-4231-a34a-befbece77c4e service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] No waiting events found dispatching network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:27 user nova-compute[73121]: WARNING nova.compute.manager [req-ccc0fc69-f5c5-43af-b813-2d720d2981a4 req-680ead1a-583e-4231-a34a-befbece77c4e service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received unexpected event network-vif-plugged-c423ec03-ba94-4691-bcc1-b7354e3b1a80 for instance with vm_state active and task_state deleting.
Aug 15 02:17:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:27 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Took 0.67 seconds to deallocate network for instance.
Aug 15 02:17:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-b230a736-4b9e-4fb9-8851-5bb2321af608 req-c86ad72a-d6d3-4fc9-9aa0-caef0ca48b0f service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b230a736-4b9e-4fb9-8851-5bb2321af608 req-c86ad72a-d6d3-4fc9-9aa0-caef0ca48b0f service nova] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b230a736-4b9e-4fb9-8851-5bb2321af608 req-c86ad72a-d6d3-4fc9-9aa0-caef0ca48b0f service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b230a736-4b9e-4fb9-8851-5bb2321af608 req-c86ad72a-d6d3-4fc9-9aa0-caef0ca48b0f service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-b230a736-4b9e-4fb9-8851-5bb2321af608 req-c86ad72a-d6d3-4fc9-9aa0-caef0ca48b0f service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] No waiting events found dispatching network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:27 user nova-compute[73121]: WARNING nova.compute.manager [req-b230a736-4b9e-4fb9-8851-5bb2321af608 req-c86ad72a-d6d3-4fc9-9aa0-caef0ca48b0f service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received unexpected event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee for instance with vm_state building and task_state spawning.
Aug 15 02:17:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updating instance_info_cache with network_info: [{"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-afb831b1-b2b9-4771-a759-47fbaa2a0382" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:28 user nova-compute[73121]: INFO nova.compute.manager [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Took 0.94 seconds to detach 1 volumes for instance.
Aug 15 02:17:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:28 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:17:28 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:17:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:28 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Deleted allocations for instance d5b2095f-df4e-4420-9dca-4552b10e3f3e
Aug 15 02:17:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf922dd6-0696-4b30-8899-8c96c7785596 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d5b2095f-df4e-4420-9dca-4552b10e3f3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.036s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065849.3260386, 454e5897-0179-41fb-a58d-c264831ee4a9 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:17:29 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] VM Resumed (Lifecycle Event)
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:17:29 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Instance spawned successfully.
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:29 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065849.3277104, 454e5897-0179-41fb-a58d-c264831ee4a9 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:17:29 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] VM Started (Lifecycle Event)
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-2e931cdb-cf15-4444-860d-8f3848c21d4a req-66948d8f-940a-4b9a-8eb7-982f18eb6c42 service nova] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Received event network-vif-deleted-c423ec03-ba94-4691-bcc1-b7354e3b1a80 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:17:29 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:17:29 user nova-compute[73121]: INFO nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Took 5.89 seconds to spawn the instance on the hypervisor.
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-158eb6f8-c19f-4dd4-8d2f-2e21b0eb9f17 req-80baaaed-0999-4e39-b962-819982e2a51b service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-158eb6f8-c19f-4dd4-8d2f-2e21b0eb9f17 req-80baaaed-0999-4e39-b962-819982e2a51b service nova] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-158eb6f8-c19f-4dd4-8d2f-2e21b0eb9f17 req-80baaaed-0999-4e39-b962-819982e2a51b service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-158eb6f8-c19f-4dd4-8d2f-2e21b0eb9f17 req-80baaaed-0999-4e39-b962-819982e2a51b service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-158eb6f8-c19f-4dd4-8d2f-2e21b0eb9f17 req-80baaaed-0999-4e39-b962-819982e2a51b service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] No waiting events found dispatching network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:29 user nova-compute[73121]: WARNING nova.compute.manager [req-158eb6f8-c19f-4dd4-8d2f-2e21b0eb9f17 req-80baaaed-0999-4e39-b962-819982e2a51b service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received unexpected event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee for instance with vm_state building and task_state spawning.
Aug 15 02:17:29 user nova-compute[73121]: INFO nova.compute.manager [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Took 19.02 seconds to build instance.
Aug 15 02:17:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4368b2b-5002-4f0b-9916-0c780102fb7d tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.129s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:17:30 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-610a10d7-5afc-40f1-8e16-59fb6d518fc8 req-a9df29b8-c797-442f-86b8-0541c1eae429 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received event network-changed-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG nova.compute.manager [req-610a10d7-5afc-40f1-8e16-59fb6d518fc8 req-a9df29b8-c797-442f-86b8-0541c1eae429 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Refreshing instance network info cache due to event network-changed-32084794-2862-47ab-b42f-d7d464ced12c. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-610a10d7-5afc-40f1-8e16-59fb6d518fc8 req-a9df29b8-c797-442f-86b8-0541c1eae429 service nova] Acquiring lock "refresh_cache-1145ac04-f2f8-49d3-a54e-365f7269d8be" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-610a10d7-5afc-40f1-8e16-59fb6d518fc8 req-a9df29b8-c797-442f-86b8-0541c1eae429 service nova] Acquired lock "refresh_cache-1145ac04-f2f8-49d3-a54e-365f7269d8be" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG nova.network.neutron [req-610a10d7-5afc-40f1-8e16-59fb6d518fc8 req-a9df29b8-c797-442f-86b8-0541c1eae429 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Refreshing network info cache for port 32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:17:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7487MB free_disk=25.117938995361328GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.objects.instance [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lazy-loading 'flavor' on Instance uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d7950f28-0893-49de-a560-bbc0791492b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance afb831b1-b2b9-4771-a759-47fbaa2a0382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1145ac04-f2f8-49d3-a54e-365f7269d8be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 9bfaa36f-2822-47de-8d12-823e38b4aae4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 454e5897-0179-41fb-a58d-c264831ee4a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 02572d81-b687-48ca-bb93-cedebe076fdf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:34 user nova-compute[73121]: INFO nova.compute.manager [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Attaching volume 3db6dd64-1618-4f1d-a35a-3011a4155612 to /dev/vdb
Aug 15 02:17:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b92ebc-65aa-4569-8b46-58d2043459a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee5b4c3-512a-498c-a355-6b41f6ede7ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3f14c2-4906-4ba5-a711-dfa04cd1f247]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6666f40e-c00c-40b7-bd82-d2c4d629afa4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:34 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5d5e05-2f34-41e8-ae5d-edf178b5fc39]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] <== get_connector_properties: return (196ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Updating existing volume attachment record: bbaf45d5-304b-420a-827b-5e823df61105 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-610a10d7-5afc-40f1-8e16-59fb6d518fc8 req-a9df29b8-c797-442f-86b8-0541c1eae429 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Updated VIF entry in instance network info cache for port 32084794-2862-47ab-b42f-d7d464ced12c. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-610a10d7-5afc-40f1-8e16-59fb6d518fc8 req-a9df29b8-c797-442f-86b8-0541c1eae429 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Updating instance_info_cache with network_info: [{"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:17:34 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Creating image(s)
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Ensure instance console log exists: /opt/stack/data/nova/instances/02572d81-b687-48ca-bb93-cedebe076fdf/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Start _get_guest_xml network_info=[{"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '4605495d-525d-4056-be12-976a746abee7', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvzRfCyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02572d81-b687-48ca-bb93-cedebe076fdf', 'attached_at': '', 'detached_at': '', 'volume_id': '8227d1ba-6670-4189-85dd-7d91a9409e5d', 'serial': '8227d1ba-6670-4189-85dd-7d91a9409e5d'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:17:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-610a10d7-5afc-40f1-8e16-59fb6d518fc8 req-a9df29b8-c797-442f-86b8-0541c1eae429 service nova] Releasing lock "refresh_cache-1145ac04-f2f8-49d3-a54e-365f7269d8be" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:17:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvzRfCyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:35 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:17:35 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:17:35 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6487190-14a7-40cd-949f-57c3f5b717c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:17:35 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54362ef-48e8-4a11-8595-bfea2feec307]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d] added
Aug 15 02:17:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[73802ea0-965b-4039-95eb-5302d92fc96c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e30f7ce-5a8a-4e87-8ccf-0220dcd41b11]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvzRfCyc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvzRfCyc" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7f7ccd-e430-460a-a0c9-e4667b89b129]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvzRfCyc'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e46a7c-c08e-4027-97b1-e8d1286db0ff]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f456f2-965b-45b7-886f-be9ee3701161]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a68e58b-cc0b-4109-99f0-4def4a0318fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260]
Aug 15 02:17:35 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260] successful.
Aug 15 02:17:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3098faf5-b151-4207-9f02-5e8bb12059f6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ff02e1-1c8e-4d92-b56d-971cfceeaeae]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:17:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:35 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:17:35 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[152223d9-3704-41be-b3df-2467422b1127]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvzRfCyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:17:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23230393735316463', 'path': '/dev/sde'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230393735316463', 'path': '/dev/sde'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-775591186',display_name='tempest-TestVolumeBootPattern-server-775591186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-775591186',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuKaje8XOyRteWQDYhsHPlBp1Xjeq99eSrwstRwpVv8kz+qsXnyj4MM3934HkKDRT/PtguSeoZK5bF8tR96SJXazwgYAgV+WiBSzEqWb7KFKLbBhYz1ys01ett7El1jYw==',key_name='tempest-TestVolumeBootPattern-929875393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-zqrs9z8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:17:13Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=02572d81-b687-48ca-bb93-cedebe076fdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=297d9181-5888-4728-8b38-39fbe97d0992,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297d9181-58') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'pci_devices' on Instance uuid 02572d81-b687-48ca-bb93-cedebe076fdf {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:17:36 user nova-compute[73121]:   <uuid>02572d81-b687-48ca-bb93-cedebe076fdf</uuid>
Aug 15 02:17:36 user nova-compute[73121]:   <name>instance-00000026</name>
Aug 15 02:17:36 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:17:36 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:17:36 user nova-compute[73121]:   <metadata>
Aug 15 02:17:36 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:17:36 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:17:36 user nova-compute[73121]:       <nova:name>tempest-TestVolumeBootPattern-server-775591186</nova:name>
Aug 15 02:17:36 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:17:34</nova:creationTime>
Aug 15 02:17:36 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:17:36 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:17:36 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:17:36 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:17:36 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:17:36 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:17:36 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:17:36 user nova-compute[73121]:       <nova:owner>
Aug 15 02:17:36 user nova-compute[73121]:         <nova:user uuid="9f9c4f2ffebb440cb88132a502d51811">tempest-TestVolumeBootPattern-151395753-project-member</nova:user>
Aug 15 02:17:36 user nova-compute[73121]:         <nova:project uuid="2e3397dd14ca44c19dc4386aec30a9a4">tempest-TestVolumeBootPattern-151395753</nova:project>
Aug 15 02:17:36 user nova-compute[73121]:       </nova:owner>
Aug 15 02:17:36 user nova-compute[73121]:       <nova:ports>
Aug 15 02:17:36 user nova-compute[73121]:         <nova:port uuid="297d9181-5888-4728-8b38-39fbe97d0992">
Aug 15 02:17:36 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 02:17:36 user nova-compute[73121]:         </nova:port>
Aug 15 02:17:36 user nova-compute[73121]:       </nova:ports>
Aug 15 02:17:36 user nova-compute[73121]:     </nova:instance>
Aug 15 02:17:36 user nova-compute[73121]:   </metadata>
Aug 15 02:17:36 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:17:36 user nova-compute[73121]:     <system>
Aug 15 02:17:36 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:17:36 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:17:36 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:17:36 user nova-compute[73121]:       <entry name="serial">02572d81-b687-48ca-bb93-cedebe076fdf</entry>
Aug 15 02:17:36 user nova-compute[73121]:       <entry name="uuid">02572d81-b687-48ca-bb93-cedebe076fdf</entry>
Aug 15 02:17:36 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:17:36 user nova-compute[73121]:     </system>
Aug 15 02:17:36 user nova-compute[73121]:   </sysinfo>
Aug 15 02:17:36 user nova-compute[73121]:   <os>
Aug 15 02:17:36 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:17:36 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:17:36 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:17:36 user nova-compute[73121]:   </os>
Aug 15 02:17:36 user nova-compute[73121]:   <features>
Aug 15 02:17:36 user nova-compute[73121]:     <acpi/>
Aug 15 02:17:36 user nova-compute[73121]:     <apic/>
Aug 15 02:17:36 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:17:36 user nova-compute[73121]:   </features>
Aug 15 02:17:36 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:17:36 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:17:36 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:17:36 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:17:36 user nova-compute[73121]:   </clock>
Aug 15 02:17:36 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:17:36 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:17:36 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:17:36 user nova-compute[73121]:   </cpu>
Aug 15 02:17:36 user nova-compute[73121]:   <devices>
Aug 15 02:17:36 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:17:36 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:17:36 user nova-compute[73121]:       <source dev="/dev/sde"/>
Aug 15 02:17:36 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:17:36 user nova-compute[73121]:       <serial>8227d1ba-6670-4189-85dd-7d91a9409e5d</serial>
Aug 15 02:17:36 user nova-compute[73121]:     </disk>
Aug 15 02:17:36 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:17:36 user nova-compute[73121]:       <mac address="fa:16:3e:4e:49:d0"/>
Aug 15 02:17:36 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:17:36 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:17:36 user nova-compute[73121]:       <target dev="tap297d9181-58"/>
Aug 15 02:17:36 user nova-compute[73121]:     </interface>
Aug 15 02:17:36 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:17:36 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/02572d81-b687-48ca-bb93-cedebe076fdf/console.log" append="off"/>
Aug 15 02:17:36 user nova-compute[73121]:     </serial>
Aug 15 02:17:36 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:17:36 user nova-compute[73121]:     <video>
Aug 15 02:17:36 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:17:36 user nova-compute[73121]:     </video>
Aug 15 02:17:36 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:17:36 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:17:36 user nova-compute[73121]:     </rng>
Aug 15 02:17:36 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:17:36 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:17:36 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:17:36 user nova-compute[73121]:     </memballoon>
Aug 15 02:17:36 user nova-compute[73121]:   </devices>
Aug 15 02:17:36 user nova-compute[73121]: </domain>
Aug 15 02:17:36 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-775591186',display_name='tempest-TestVolumeBootPattern-server-775591186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-775591186',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuKaje8XOyRteWQDYhsHPlBp1Xjeq99eSrwstRwpVv8kz+qsXnyj4MM3934HkKDRT/PtguSeoZK5bF8tR96SJXazwgYAgV+WiBSzEqWb7KFKLbBhYz1ys01ett7El1jYw==',key_name='tempest-TestVolumeBootPattern-929875393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-zqrs9z8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:17:13Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=02572d81-b687-48ca-bb93-cedebe076fdf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=297d9181-5888-4728-8b38-39fbe97d0992,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297d9181-58') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG os_vif [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=297d9181-5888-4728-8b38-39fbe97d0992,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297d9181-58') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap297d9181-58, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap297d9181-58, col_values=(('external_ids', {'iface-id': '297d9181-5888-4728-8b38-39fbe97d0992', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:49:d0', 'vm-uuid': '02572d81-b687-48ca-bb93-cedebe076fdf'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:36 user nova-compute[73121]: INFO os_vif [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=297d9181-5888-4728-8b38-39fbe97d0992,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297d9181-58')
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:17:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No VIF found with MAC fa:16:3e:4e:49:d0, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:17:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-7dd19850-88e3-41c7-b06a-4a5d9344ace6 req-6424e5da-3ff7-4a72-ad16-9c21d313e11a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received event network-vif-plugged-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7dd19850-88e3-41c7-b06a-4a5d9344ace6 req-6424e5da-3ff7-4a72-ad16-9c21d313e11a service nova] Acquiring lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7dd19850-88e3-41c7-b06a-4a5d9344ace6 req-6424e5da-3ff7-4a72-ad16-9c21d313e11a service nova] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7dd19850-88e3-41c7-b06a-4a5d9344ace6 req-6424e5da-3ff7-4a72-ad16-9c21d313e11a service nova] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-7dd19850-88e3-41c7-b06a-4a5d9344ace6 req-6424e5da-3ff7-4a72-ad16-9c21d313e11a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] No waiting events found dispatching network-vif-plugged-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:38 user nova-compute[73121]: WARNING nova.compute.manager [req-7dd19850-88e3-41c7-b06a-4a5d9344ace6 req-6424e5da-3ff7-4a72-ad16-9c21d313e11a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received unexpected event network-vif-plugged-297d9181-5888-4728-8b38-39fbe97d0992 for instance with vm_state building and task_state spawning.
Aug 15 02:17:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:17:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:39 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:17:39 user nova-compute[73121]: INFO nova.compute.claims [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Claim successful on node user
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-798c46ce-0507-4bf4-9afa-3283aaae9b46 req-1a6477d1-f5fb-4314-b47b-91854384996a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received event network-vif-plugged-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-798c46ce-0507-4bf4-9afa-3283aaae9b46 req-1a6477d1-f5fb-4314-b47b-91854384996a service nova] Acquiring lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-798c46ce-0507-4bf4-9afa-3283aaae9b46 req-1a6477d1-f5fb-4314-b47b-91854384996a service nova] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-798c46ce-0507-4bf4-9afa-3283aaae9b46 req-1a6477d1-f5fb-4314-b47b-91854384996a service nova] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-798c46ce-0507-4bf4-9afa-3283aaae9b46 req-1a6477d1-f5fb-4314-b47b-91854384996a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] No waiting events found dispatching network-vif-plugged-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:40 user nova-compute[73121]: WARNING nova.compute.manager [req-798c46ce-0507-4bf4-9afa-3283aaae9b46 req-1a6477d1-f5fb-4314-b47b-91854384996a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received unexpected event network-vif-plugged-297d9181-5888-4728-8b38-39fbe97d0992 for instance with vm_state building and task_state spawning.
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065860.3101046, 02572d81-b687-48ca-bb93-cedebe076fdf => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:17:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] VM Resumed (Lifecycle Event)
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:17:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Instance spawned successfully.
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:17:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065860.312896, 02572d81-b687-48ca-bb93-cedebe076fdf => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:17:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] VM Started (Lifecycle Event)
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:17:40 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:17:40 user nova-compute[73121]: INFO nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:17:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:17:40 user nova-compute[73121]: INFO nova.compute.manager [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Took 28.55 seconds to build instance.
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f83c5fd3-21c5-4a7d-b842-9f844bf6d583 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "02572d81-b687-48ca-bb93-cedebe076fdf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.690s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.policy [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3992e0609efb4ad389253810ab9b0d33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1b3c8eef30d43d98388840e389efc24', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:17:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Creating image(s)
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "/opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "/opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "/opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "9db766a6e9ab5731fa1616733e18854ba99e1f06" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "9db766a6e9ab5731fa1616733e18854ba99e1f06" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065846.138824, d5b2095f-df4e-4420-9dca-4552b10e3f3e => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:17:41 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] VM Stopped (Lifecycle Event)
Aug 15 02:17:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5d35c23c-c44f-46b5-921e-f9499ecdda7f None None] [instance: d5b2095f-df4e-4420-9dca-4552b10e3f3e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:41 user nova-compute[73121]: INFO nova.compute.manager [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Terminating instance
Aug 15 02:17:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06.part --force-share --output=json" returned: 0 in 0.237s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG nova.virt.images [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] 4cb2e30e-ef2d-46cd-a433-71c9a278c4c0 was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06.part /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Successfully created port: fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06.part /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06.converted" returned: 0 in 0.437s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-a09341d0-52e6-4c62-bbd0-5fb65df4f790 req-e3cc1dce-00cf-4341-a37c-2070d85c4c54 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received event network-vif-unplugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a09341d0-52e6-4c62-bbd0-5fb65df4f790 req-e3cc1dce-00cf-4341-a37c-2070d85c4c54 service nova] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a09341d0-52e6-4c62-bbd0-5fb65df4f790 req-e3cc1dce-00cf-4341-a37c-2070d85c4c54 service nova] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a09341d0-52e6-4c62-bbd0-5fb65df4f790 req-e3cc1dce-00cf-4341-a37c-2070d85c4c54 service nova] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-a09341d0-52e6-4c62-bbd0-5fb65df4f790 req-e3cc1dce-00cf-4341-a37c-2070d85c4c54 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] No waiting events found dispatching network-vif-unplugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-a09341d0-52e6-4c62-bbd0-5fb65df4f790 req-e3cc1dce-00cf-4341-a37c-2070d85c4c54 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received event network-vif-unplugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06.converted --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "9db766a6e9ab5731fa1616733e18854ba99e1f06" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.599s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06 --force-share --output=json" returned: 0 in 0.250s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "9db766a6e9ab5731fa1616733e18854ba99e1f06" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "9db766a6e9ab5731fa1616733e18854ba99e1f06" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:42 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Instance destroyed successfully.
Aug 15 02:17:42 user nova-compute[73121]: DEBUG nova.objects.instance [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lazy-loading 'resources' on Instance uuid afb831b1-b2b9-4771-a759-47fbaa2a0382 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:09:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-478408445',display_name='tempest-SnapshotDataIntegrityTests-server-478408445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-478408445',id=26,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGO7dI2Mqqft7ydkiwRi7SUQU7xhIZF504f/WyU8muWBqKoNXTise1De59N2cBMepA2d80+SiQEyS7JCoNou7LzyX1Ds2aRTq28WXGZE1UvWz4sMzxwhX381VVPxtnEtfg==',key_name='tempest-keypair-485584573',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:09:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='547392e371404b7ebb8e83f9cbba108a',ramdisk_id='',reservation_id='r-lzg6jjo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-293199597',owner_user_name='tempest-SnapshotDataIntegrityTests-293199597-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:09:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38933c03922f45f394cabbf65159d3fb',uuid=afb831b1-b2b9-4771-a759-47fbaa2a0382,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Converting VIF {"id": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "address": "fa:16:3e:1c:c1:76", "network": {"id": "e05cd91f-a287-46de-8159-b5dbc49e9896", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1620408766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "547392e371404b7ebb8e83f9cbba108a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabf3d1bd-5c", "ovs_interfaceid": "abf3d1bd-5c66-4e3a-8aa3-2323ced964fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:c1:76,bridge_name='br-int',has_traffic_filtering=True,id=abf3d1bd-5c66-4e3a-8aa3-2323ced964fb,network=Network(e05cd91f-a287-46de-8159-b5dbc49e9896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf3d1bd-5c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG os_vif [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:c1:76,bridge_name='br-int',has_traffic_filtering=True,id=abf3d1bd-5c66-4e3a-8aa3-2323ced964fb,network=Network(e05cd91f-a287-46de-8159-b5dbc49e9896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf3d1bd-5c') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabf3d1bd-5c, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:17:42 user nova-compute[73121]: INFO os_vif [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:c1:76,bridge_name='br-int',has_traffic_filtering=True,id=abf3d1bd-5c66-4e3a-8aa3-2323ced964fb,network=Network(e05cd91f-a287-46de-8159-b5dbc49e9896),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabf3d1bd-5c')
Aug 15 02:17:42 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Deleting instance files /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382_del
Aug 15 02:17:42 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Deletion of /opt/stack/data/nova/instances/afb831b1-b2b9-4771-a759-47fbaa2a0382_del complete
Aug 15 02:17:42 user nova-compute[73121]: INFO nova.compute.manager [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06 --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06,backing_fmt=raw /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06,backing_fmt=raw /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk 1073741824" returned: 0 in 0.051s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "9db766a6e9ab5731fa1616733e18854ba99e1f06" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06 --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Successfully updated port: fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquired lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-cabc2b14-a18e-4fe4-868d-3385eda1938a req-8534bd44-e3f6-4b32-ab22-e6351ee9660b service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-cabc2b14-a18e-4fe4-868d-3385eda1938a req-8534bd44-e3f6-4b32-ab22-e6351ee9660b service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing instance network info cache due to event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cabc2b14-a18e-4fe4-868d-3385eda1938a req-8534bd44-e3f6-4b32-ab22-e6351ee9660b service nova] Acquiring lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.402s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Cannot resize image /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'migration_context' on Instance uuid 6fb561dc-705f-4bde-98a5-2076a9e1f8fe {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Ensure instance console log exists: /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating instance_info_cache with network_info: [{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Releasing lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Instance network_info: |[{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cabc2b14-a18e-4fe4-868d-3385eda1938a req-8534bd44-e3f6-4b32-ab22-e6351ee9660b service nova] Acquired lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-cabc2b14-a18e-4fe4-868d-3385eda1938a req-8534bd44-e3f6-4b32-ab22-e6351ee9660b service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Start _get_guest_xml network_info=[{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T02:17:36Z,direct_url=<?>,disk_format='qcow2',id=4cb2e30e-ef2d-46cd-a433-71c9a278c4c0,min_disk=0,min_ram=0,name='tempest-scenario-img--1327139773',owner='b1b3c8eef30d43d98388840e389efc24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T02:17:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '4cb2e30e-ef2d-46cd-a433-71c9a278c4c0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-90bacde3-95f6-4e2d-a925-7bae3d6b2e6f req-defbf07e-3509-4808-9783-18ab79ea372a service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received event network-vif-plugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-90bacde3-95f6-4e2d-a925-7bae3d6b2e6f req-defbf07e-3509-4808-9783-18ab79ea372a service nova] Acquiring lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-90bacde3-95f6-4e2d-a925-7bae3d6b2e6f req-defbf07e-3509-4808-9783-18ab79ea372a service nova] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-90bacde3-95f6-4e2d-a925-7bae3d6b2e6f req-defbf07e-3509-4808-9783-18ab79ea372a service nova] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-90bacde3-95f6-4e2d-a925-7bae3d6b2e6f req-defbf07e-3509-4808-9783-18ab79ea372a service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] No waiting events found dispatching network-vif-plugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:44 user nova-compute[73121]: WARNING nova.compute.manager [req-90bacde3-95f6-4e2d-a925-7bae3d6b2e6f req-defbf07e-3509-4808-9783-18ab79ea372a service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received unexpected event network-vif-plugged-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb for instance with vm_state active and task_state deleting.
Aug 15 02:17:44 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:17:44 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T02:17:36Z,direct_url=<?>,disk_format='qcow2',id=4cb2e30e-ef2d-46cd-a433-71c9a278c4c0,min_disk=0,min_ram=0,name='tempest-scenario-img--1327139773',owner='b1b3c8eef30d43d98388840e389efc24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T02:17:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2146820867',display_name='tempest-TestMinimumBasicScenario-server-2146820867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2146820867',id=39,image_ref='4cb2e30e-ef2d-46cd-a433-71c9a278c4c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDk5uMeIlAl6UKfNNSXNpk4cf5/qITn9En3eHzRRlGTvambTXNQDC5DPhcMh9oQMfcuWQEsZCd/GpymQ+EwBw7c8rY8rahLjkPSllvGMOppi61fWgj7UBNdDwXeBNf65w==',key_name='tempest-TestMinimumBasicScenario-1339006850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3c8eef30d43d98388840e389efc24',ramdisk_id='',reservation_id='r-3qmp9mn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4cb2e30e-ef2d-46cd-a433-71c9a278c4c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2011934660',owner_user_name='tempest-TestMinimumBasicScenario-2011934660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:17:41Z,user_data=None,user_id='3992e0609efb4ad389253810ab9b0d33',uuid=6fb561dc-705f-4bde-98a5-2076a9e1f8fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converting VIF {"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fa:55,bridge_name='br-int',has_traffic_filtering=True,id=fdec51f1-db71-4432-81de-2f4de0f7d3b2,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdec51f1-db') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'pci_devices' on Instance uuid 6fb561dc-705f-4bde-98a5-2076a9e1f8fe {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:17:44 user nova-compute[73121]:   <uuid>6fb561dc-705f-4bde-98a5-2076a9e1f8fe</uuid>
Aug 15 02:17:44 user nova-compute[73121]:   <name>instance-00000027</name>
Aug 15 02:17:44 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:17:44 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:17:44 user nova-compute[73121]:   <metadata>
Aug 15 02:17:44 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:17:44 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:17:44 user nova-compute[73121]:       <nova:name>tempest-TestMinimumBasicScenario-server-2146820867</nova:name>
Aug 15 02:17:44 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:17:44</nova:creationTime>
Aug 15 02:17:44 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:17:44 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:17:44 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:17:44 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:17:44 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:17:44 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:17:44 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:17:44 user nova-compute[73121]:       <nova:owner>
Aug 15 02:17:44 user nova-compute[73121]:         <nova:user uuid="3992e0609efb4ad389253810ab9b0d33">tempest-TestMinimumBasicScenario-2011934660-project-member</nova:user>
Aug 15 02:17:44 user nova-compute[73121]:         <nova:project uuid="b1b3c8eef30d43d98388840e389efc24">tempest-TestMinimumBasicScenario-2011934660</nova:project>
Aug 15 02:17:44 user nova-compute[73121]:       </nova:owner>
Aug 15 02:17:44 user nova-compute[73121]:       <nova:root type="image" uuid="4cb2e30e-ef2d-46cd-a433-71c9a278c4c0"/>
Aug 15 02:17:44 user nova-compute[73121]:       <nova:ports>
Aug 15 02:17:44 user nova-compute[73121]:         <nova:port uuid="fdec51f1-db71-4432-81de-2f4de0f7d3b2">
Aug 15 02:17:44 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 02:17:44 user nova-compute[73121]:         </nova:port>
Aug 15 02:17:44 user nova-compute[73121]:       </nova:ports>
Aug 15 02:17:44 user nova-compute[73121]:     </nova:instance>
Aug 15 02:17:44 user nova-compute[73121]:   </metadata>
Aug 15 02:17:44 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:17:44 user nova-compute[73121]:     <system>
Aug 15 02:17:44 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:17:44 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:17:44 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:17:44 user nova-compute[73121]:       <entry name="serial">6fb561dc-705f-4bde-98a5-2076a9e1f8fe</entry>
Aug 15 02:17:44 user nova-compute[73121]:       <entry name="uuid">6fb561dc-705f-4bde-98a5-2076a9e1f8fe</entry>
Aug 15 02:17:44 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:17:44 user nova-compute[73121]:     </system>
Aug 15 02:17:44 user nova-compute[73121]:   </sysinfo>
Aug 15 02:17:44 user nova-compute[73121]:   <os>
Aug 15 02:17:44 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:17:44 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:17:44 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:17:44 user nova-compute[73121]:   </os>
Aug 15 02:17:44 user nova-compute[73121]:   <features>
Aug 15 02:17:44 user nova-compute[73121]:     <acpi/>
Aug 15 02:17:44 user nova-compute[73121]:     <apic/>
Aug 15 02:17:44 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:17:44 user nova-compute[73121]:   </features>
Aug 15 02:17:44 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:17:44 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:17:44 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:17:44 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:17:44 user nova-compute[73121]:   </clock>
Aug 15 02:17:44 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:17:44 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:17:44 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:17:44 user nova-compute[73121]:   </cpu>
Aug 15 02:17:44 user nova-compute[73121]:   <devices>
Aug 15 02:17:44 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:17:44 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:17:44 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk"/>
Aug 15 02:17:44 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:17:44 user nova-compute[73121]:     </disk>
Aug 15 02:17:44 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:17:44 user nova-compute[73121]:       <mac address="fa:16:3e:9f:fa:55"/>
Aug 15 02:17:44 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:17:44 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:17:44 user nova-compute[73121]:       <target dev="tapfdec51f1-db"/>
Aug 15 02:17:44 user nova-compute[73121]:     </interface>
Aug 15 02:17:44 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:17:44 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/console.log" append="off"/>
Aug 15 02:17:44 user nova-compute[73121]:     </serial>
Aug 15 02:17:44 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:17:44 user nova-compute[73121]:     <video>
Aug 15 02:17:44 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:17:44 user nova-compute[73121]:     </video>
Aug 15 02:17:44 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:17:44 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:17:44 user nova-compute[73121]:     </rng>
Aug 15 02:17:44 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:17:44 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:17:44 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:17:44 user nova-compute[73121]:     </memballoon>
Aug 15 02:17:44 user nova-compute[73121]:   </devices>
Aug 15 02:17:44 user nova-compute[73121]: </domain>
Aug 15 02:17:44 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2146820867',display_name='tempest-TestMinimumBasicScenario-server-2146820867',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2146820867',id=39,image_ref='4cb2e30e-ef2d-46cd-a433-71c9a278c4c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDk5uMeIlAl6UKfNNSXNpk4cf5/qITn9En3eHzRRlGTvambTXNQDC5DPhcMh9oQMfcuWQEsZCd/GpymQ+EwBw7c8rY8rahLjkPSllvGMOppi61fWgj7UBNdDwXeBNf65w==',key_name='tempest-TestMinimumBasicScenario-1339006850',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b1b3c8eef30d43d98388840e389efc24',ramdisk_id='',reservation_id='r-3qmp9mn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4cb2e30e-ef2d-46cd-a433-71c9a278c4c0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2011934660',owner_user_name='tempest-TestMinimumBasicScenario-2011934660-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:17:41Z,user_data=None,user_id='3992e0609efb4ad389253810ab9b0d33',uuid=6fb561dc-705f-4bde-98a5-2076a9e1f8fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converting VIF {"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fa:55,bridge_name='br-int',has_traffic_filtering=True,id=fdec51f1-db71-4432-81de-2f4de0f7d3b2,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdec51f1-db') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG os_vif [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fa:55,bridge_name='br-int',has_traffic_filtering=True,id=fdec51f1-db71-4432-81de-2f4de0f7d3b2,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdec51f1-db') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdec51f1-db, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdec51f1-db, col_values=(('external_ids', {'iface-id': 'fdec51f1-db71-4432-81de-2f4de0f7d3b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:fa:55', 'vm-uuid': '6fb561dc-705f-4bde-98a5-2076a9e1f8fe'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:44 user nova-compute[73121]: INFO os_vif [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:fa:55,bridge_name='br-int',has_traffic_filtering=True,id=fdec51f1-db71-4432-81de-2f4de0f7d3b2,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdec51f1-db')
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No VIF found with MAC fa:16:3e:9f:fa:55, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:44 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Took 1.81 seconds to deallocate network for instance.
Aug 15 02:17:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-cabc2b14-a18e-4fe4-868d-3385eda1938a req-8534bd44-e3f6-4b32-ab22-e6351ee9660b service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updated VIF entry in instance network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-cabc2b14-a18e-4fe4-868d-3385eda1938a req-8534bd44-e3f6-4b32-ab22-e6351ee9660b service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating instance_info_cache with network_info: [{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cabc2b14-a18e-4fe4-868d-3385eda1938a req-8534bd44-e3f6-4b32-ab22-e6351ee9660b service nova] Releasing lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:45 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:17:45 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:17:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:45 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Deleted allocations for instance afb831b1-b2b9-4771-a759-47fbaa2a0382
Aug 15 02:17:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-862a3e2a-38e0-473b-8d61-152573dd8793 tempest-SnapshotDataIntegrityTests-293199597 tempest-SnapshotDataIntegrityTests-293199597-project-member] Lock "afb831b1-b2b9-4771-a759-47fbaa2a0382" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.719s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-129018a9-bd38-490e-b9d4-e94cd58f5ce6 req-1207add2-609b-4690-9750-cc1bb47d87f7 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-129018a9-bd38-490e-b9d4-e94cd58f5ce6 req-1207add2-609b-4690-9750-cc1bb47d87f7 service nova] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-129018a9-bd38-490e-b9d4-e94cd58f5ce6 req-1207add2-609b-4690-9750-cc1bb47d87f7 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-129018a9-bd38-490e-b9d4-e94cd58f5ce6 req-1207add2-609b-4690-9750-cc1bb47d87f7 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-129018a9-bd38-490e-b9d4-e94cd58f5ce6 req-1207add2-609b-4690-9750-cc1bb47d87f7 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] No waiting events found dispatching network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:46 user nova-compute[73121]: WARNING nova.compute.manager [req-129018a9-bd38-490e-b9d4-e94cd58f5ce6 req-1207add2-609b-4690-9750-cc1bb47d87f7 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received unexpected event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 for instance with vm_state building and task_state spawning.
Aug 15 02:17:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-a0d3680c-3480-4a98-b687-f99fd6cf7783 req-508f8958-2252-49ef-a4f1-39edd17f4787 service nova] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Received event network-vif-deleted-abf3d1bd-5c66-4e3a-8aa3-2323ced964fb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-d34f96e9-2be9-48a9-9aee-ee63016175c3 req-8d59f7a3-412c-42e0-bc0a-ed78261c628c service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received event network-changed-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-d34f96e9-2be9-48a9-9aee-ee63016175c3 req-8d59f7a3-412c-42e0-bc0a-ed78261c628c service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Refreshing instance network info cache due to event network-changed-b77ab60c-66e8-4d0e-998d-86d6053a465d. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:17:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d34f96e9-2be9-48a9-9aee-ee63016175c3 req-8d59f7a3-412c-42e0-bc0a-ed78261c628c service nova] Acquiring lock "refresh_cache-9bfaa36f-2822-47de-8d12-823e38b4aae4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:17:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d34f96e9-2be9-48a9-9aee-ee63016175c3 req-8d59f7a3-412c-42e0-bc0a-ed78261c628c service nova] Acquired lock "refresh_cache-9bfaa36f-2822-47de-8d12-823e38b4aae4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:17:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-d34f96e9-2be9-48a9-9aee-ee63016175c3 req-8d59f7a3-412c-42e0-bc0a-ed78261c628c service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Refreshing network info cache for port b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:17:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-d34f96e9-2be9-48a9-9aee-ee63016175c3 req-8d59f7a3-412c-42e0-bc0a-ed78261c628c service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Updated VIF entry in instance network info cache for port b77ab60c-66e8-4d0e-998d-86d6053a465d. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:17:47 user nova-compute[73121]: DEBUG nova.network.neutron [req-d34f96e9-2be9-48a9-9aee-ee63016175c3 req-8d59f7a3-412c-42e0-bc0a-ed78261c628c service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Updating instance_info_cache with network_info: [{"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d34f96e9-2be9-48a9-9aee-ee63016175c3 req-8d59f7a3-412c-42e0-bc0a-ed78261c628c service nova] Releasing lock "refresh_cache-9bfaa36f-2822-47de-8d12-823e38b4aae4" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-acb9e060-23bd-4907-b325-64b7681b710a req-b1174376-1e94-44ef-bc76-3f63e9802a65 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-acb9e060-23bd-4907-b325-64b7681b710a req-b1174376-1e94-44ef-bc76-3f63e9802a65 service nova] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-acb9e060-23bd-4907-b325-64b7681b710a req-b1174376-1e94-44ef-bc76-3f63e9802a65 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-acb9e060-23bd-4907-b325-64b7681b710a req-b1174376-1e94-44ef-bc76-3f63e9802a65 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-acb9e060-23bd-4907-b325-64b7681b710a req-b1174376-1e94-44ef-bc76-3f63e9802a65 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] No waiting events found dispatching network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:17:48 user nova-compute[73121]: WARNING nova.compute.manager [req-acb9e060-23bd-4907-b325-64b7681b710a req-b1174376-1e94-44ef-bc76-3f63e9802a65 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received unexpected event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 for instance with vm_state building and task_state spawning.
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065868.3319442, 6fb561dc-705f-4bde-98a5-2076a9e1f8fe => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:17:48 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] VM Resumed (Lifecycle Event)
Aug 15 02:17:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Instance spawned successfully.
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:17:48 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065868.3331285, 6fb561dc-705f-4bde-98a5-2076a9e1f8fe => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:17:48 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] VM Started (Lifecycle Event)
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:17:48 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:17:48 user nova-compute[73121]: INFO nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Took 7.77 seconds to spawn the instance on the hypervisor.
Aug 15 02:17:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:48 user nova-compute[73121]: INFO nova.compute.manager [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Took 8.76 seconds to build instance.
Aug 15 02:17:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5dc6df78-efd9-40fe-ad8b-df8cf090d744 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.866s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRYewPtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:52 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:17:52 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:17:52 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced4ac3c-3cfe-4f14-9c2a-43bf90244802]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:17:52 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba8de61-44c2-4ebb-a3c9-1659e43fd161]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612] added
Aug 15 02:17:52 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a55a2b-84de-4a7c-9fe7-c49f45daf1ad]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdd7e5e-0152-47d5-a247-f2292479ad0f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRYewPtU {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZRYewPtU" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1def2651-b9c0-4557-8ee6-966f33590a0e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZRYewPtU'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8a3079-a77b-40ff-991e-0ab3ca0acb3d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[997e4735-7fad-4925-8bc0-c010d2694023]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:52 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:52 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:52 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:17:52 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:52 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:52 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:52 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:17:52 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --login" returned: 0 in 1.092s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[146b0154-87a0-45ac-bb73-7e983ff607ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612, portal: 172.16.0.220,3260]
Aug 15 02:17:53 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612, portal: 172.16.0.220,3260] successful.
Aug 15 02:17:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[83efbe14-bc40-403b-ba67-0fd51d82616a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cc377b-0979-4ae5-b39e-01859bc2a730]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:53 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:53 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:53 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:17:53 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:17:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:17:53 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:17:53 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:17:53 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:17:53 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:17:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.383s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[491a87ef-0a1b-4336-8b06-31d0ca8fd722]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRYewPtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'flavor' on Instance uuid 9bfaa36f-2822-47de-8d12-823e38b4aae4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:53 user nova-compute[73121]: INFO nova.compute.manager [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Attaching volume d181e562-7fb8-4ee8-b566-6c34e668639a to /dev/vdb
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.utils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f84659-4ddd-4cb0-bf79-671223e3ac53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa8271a-df0a-4b6b-8030-d6abfa839349]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc35dda-5467-42ce-9fe5-9b393a826762]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef102d3-7e20-4970-a9f2-0c7210fa0798]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:17:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:54 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:17:54 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a40c5d-6ed5-4054-bc72-92b5af561724]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG os_brick.utils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Updating existing volume attachment record: 00449854-620c-4f73-9063-77f5e30787b7 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.436s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] <== connect_volume: return (2438ms) {'type': 'block', 'scsi_wwn': '26239303330396537', 'path': '/dev/sdf'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239303330396537', 'path': '/dev/sdf'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG nova.objects.instance [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lazy-loading 'flavor' on Instance uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:17:54 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:17:54 user nova-compute[73121]:   <source dev="/dev/sdf"/>
Aug 15 02:17:54 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:17:54 user nova-compute[73121]:   <serial>3db6dd64-1618-4f1d-a35a-3011a4155612</serial>
Aug 15 02:17:54 user nova-compute[73121]: </disk>
Aug 15 02:17:54 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:17:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] No VIF found with MAC fa:16:3e:78:dc:e8, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:17:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-568fedc7-25d2-4a1d-9bb3-1968e08198e2 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.631s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:57 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065862.6273694, afb831b1-b2b9-4771-a759-47fbaa2a0382 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:17:57 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] VM Stopped (Lifecycle Event)
Aug 15 02:17:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-52c8be98-dd90-4792-a052-027ede41bf0b None None] [instance: afb831b1-b2b9-4771-a759-47fbaa2a0382] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:17:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lazy-loading 'flavor' on Instance uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:17:58 user nova-compute[73121]: INFO nova.compute.manager [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Attaching volume 0539a0ca-5dc9-46ed-8993-b9383c5eec9c to /dev/vdc
Aug 15 02:17:58 user nova-compute[73121]: DEBUG os_brick.utils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca975f7a-cd66-4cef-b832-10495264cf9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a27d407-a50e-494c-9651-b8c9bf49a209]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[824417bb-ca17-4de2-9a26-9ebd40574d0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfba541f-9579-4887-b691-25aa7494a40f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:17:58 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:17:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9a7005-cfc9-4d1d-8df2-a87c0d38cea0]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG os_brick.utils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:17:58 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Updating existing volume attachment record: 30c8aa3c-7bad-4dc7-a92d-4f1b15f63dae {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:17:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhDJtKAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:18:08 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:18:08 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:18:08 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2769e474-26ea-4b0c-aa32-30b90415a4da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:18:08 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f79b92b-00ee-48b7-b8a3-4ba2fd84e4ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c] added
Aug 15 02:18:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c32381-b7e6-4fc2-93aa-3f90ab584d98]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e462cc1e-0635-4b0c-963c-5ff9539dde7a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhDJtKAa {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IhDJtKAa" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[62df5a46-7f82-41ac-bfb6-a1ef62ddeda3]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IhDJtKAa'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1468829-2049-4b35-82f2-fa953f7fcf7e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[20474093-ce52-453d-9983-5b12d2c6d724]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c2a328-f440-4808-98c5-55b3c9e14897]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c, portal: 172.16.0.220,3260]
Aug 15 02:18:08 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c, portal: 172.16.0.220,3260] successful.
Aug 15 02:18:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4739a144-9ad8-4b19-873e-47eb78563df4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1698fa-564d-4914-a882-a74db4449e36]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)
Aug 15 02:18:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:08 user nova-compute[73121]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)
Aug 15 02:18:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] HCTL ('38', '-', '-', 0) found on session 47 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c3b8ff-b2b5-4942-9ac0-a5fe25607a06]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:08 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:18:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:18:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhDJtKAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:18:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:18:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23436623337323834', 'path': '/dev/sdg'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:18:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436623337323834', 'path': '/dev/sdg'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:18:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lazy-loading 'flavor' on Instance uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:18:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:18:09 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:18:09 user nova-compute[73121]:   <source dev="/dev/sdg"/>
Aug 15 02:18:09 user nova-compute[73121]:   <target dev="vdc" bus="virtio"/>
Aug 15 02:18:09 user nova-compute[73121]:   <serial>0539a0ca-5dc9-46ed-8993-b9383c5eec9c</serial>
Aug 15 02:18:09 user nova-compute[73121]: </disk>
Aug 15 02:18:09 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] No VIF found with MAC fa:16:3e:78:dc:e8, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-97d8f86b-e2ba-456e-a068-ba53da532ede tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.751s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhxQlaBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:18:10 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:18:10 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:18:10 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9de4eea-c01a-48f4-9fc1-acb1187d0d7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:18:10 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e378dcb-a729-4065-ad46-a8021da5d64a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a] added
Aug 15 02:18:10 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[124203ad-8e58-4c51-b98c-03e86a6199f5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f12dcb-6297-412c-a7f6-ddd031d399af]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhxQlaBT {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zhxQlaBT" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac62962-c7df-4e49-a53e-a0349b510749]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zhxQlaBT'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8e6612-3aa7-413a-aefe-0036401a15a4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[151779b4-6148-4386-b158-75d91db07320]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)
Aug 15 02:18:10 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:10 user nova-compute[73121]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)
Aug 15 02:18:10 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:18:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa173d8a-3739-4eaa-afc8-d8ce028681e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a, portal: 172.16.0.220,3260]
Aug 15 02:18:11 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a, portal: 172.16.0.220,3260] successful.
Aug 15 02:18:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e67fed6-e653-4d34-9b04-39ab2fb98cdf]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[53808fbd-65df-44d0-bcb0-24811bf37bad]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a (non-flash)
Aug 15 02:18:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)
Aug 15 02:18:11 user nova-compute[73121]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a (non-flash)
Aug 15 02:18:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] HCTL ('39', '-', '-', 0) found on session 48 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0119672-1ebe-48a6-ad14-390d1b79772e]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Searching for a device in session 48 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhxQlaBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:11 user nova-compute[73121]: INFO nova.compute.manager [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Detaching volume 0539a0ca-5dc9-46ed-8993-b9383c5eec9c
Aug 15 02:18:12 user nova-compute[73121]: INFO nova.virt.block_device [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Attempting to driver detach volume 0539a0ca-5dc9-46ed-8993-b9383c5eec9c from mountpoint /dev/vdc
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Attempting to detach device vdc from instance 1145ac04-f2f8-49d3-a54e-365f7269d8be from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:18:12 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:18:12 user nova-compute[73121]:   <source dev="/dev/sdg"/>
Aug 15 02:18:12 user nova-compute[73121]:   <target dev="vdc" bus="virtio"/>
Aug 15 02:18:12 user nova-compute[73121]:   <serial>0539a0ca-5dc9-46ed-8993-b9383c5eec9c</serial>
Aug 15 02:18:12 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 02:18:12 user nova-compute[73121]: </disk>
Aug 15 02:18:12 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:18:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Successfully detached device vdc from instance 1145ac04-f2f8-49d3-a54e-365f7269d8be from the persistent domain config.
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 1145ac04-f2f8-49d3-a54e-365f7269d8be from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:18:12 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:18:12 user nova-compute[73121]:   <source dev="/dev/sdg"/>
Aug 15 02:18:12 user nova-compute[73121]:   <target dev="vdc" bus="virtio"/>
Aug 15 02:18:12 user nova-compute[73121]:   <serial>0539a0ca-5dc9-46ed-8993-b9383c5eec9c</serial>
Aug 15 02:18:12 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 02:18:12 user nova-compute[73121]: </disk>
Aug 15 02:18:12 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23263636533353632', 'path': '/dev/sdh'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263636533353632', 'path': '/dev/sdh'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'flavor' on Instance uuid 9bfaa36f-2822-47de-8d12-823e38b4aae4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:18:12 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:18:12 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:18:12 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:18:12 user nova-compute[73121]:   <serial>d181e562-7fb8-4ee8-b566-6c34e668639a</serial>
Aug 15 02:18:12 user nova-compute[73121]: </disk>
Aug 15 02:18:12 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] No VIF found with MAC fa:16:3e:7a:9a:fb, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ba007b9b-0563-41c3-a376-1f6a58b18d58 tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.911s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065892.7990823, 1145ac04-f2f8-49d3-a54e-365f7269d8be => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:18:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Successfully detached device vdc from instance 1145ac04-f2f8-49d3-a54e-365f7269d8be from the live domain config.
Aug 15 02:18:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IhDJtKAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:18:12 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[13085e68-9bdc-4c80-9257-82308b422cd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ba48e9-68d5-42a2-b258-3c53131c1988]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a (non-flash)
Aug 15 02:18:12 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c (non-flash)
Aug 15 02:18:12 user nova-compute[73121]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a (non-flash)
Aug 15 02:18:12 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc78a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c'): ({'sdg'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Removing single pathed devices sdg {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[244064ec-ce5c-41b8-bc6c-3c3c5675d061]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c30fc7-93b6-4e75-b249-a15eeb3abbd8]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Flushing IO for device /dev/sdg {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52f0d57-7b69-4d47-bc6a-91f44d49de37]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[664f5d32-ce00-484e-bf9e-89b14758bd64]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] SCSI volumes sdg have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:18:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f604f218-8482-4b87-9b41-f68231a7bb13]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[695cc534-d506-4437-b74d-a3d0dea981d7]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c, portal: 172.16.0.220,3260]
Aug 15 02:18:13 user nova-compute[73121]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c, portal: 172.16.0.220,3260] successful.
Aug 15 02:18:13 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0539a0ca-5dc9-46ed-8993-b9383c5eec9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffde018-8d80-4828-b76e-495aedbfadda]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] <== disconnect_volume: return (311ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:13 user nova-compute[73121]: INFO nova.compute.manager [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Detaching volume d181e562-7fb8-4ee8-b566-6c34e668639a
Aug 15 02:18:13 user nova-compute[73121]: INFO nova.virt.block_device [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Attempting to driver detach volume d181e562-7fb8-4ee8-b566-6c34e668639a from mountpoint /dev/vdb
Aug 15 02:18:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Attempting to detach device vdb from instance 9bfaa36f-2822-47de-8d12-823e38b4aae4 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:18:13 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:18:13 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:18:13 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:18:13 user nova-compute[73121]:   <serial>d181e562-7fb8-4ee8-b566-6c34e668639a</serial>
Aug 15 02:18:13 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:18:13 user nova-compute[73121]: </disk>
Aug 15 02:18:13 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:18:13 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully detached device vdb from instance 9bfaa36f-2822-47de-8d12-823e38b4aae4 from the persistent domain config.
Aug 15 02:18:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bfaa36f-2822-47de-8d12-823e38b4aae4 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:18:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:18:13 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:18:13 user nova-compute[73121]:   <source dev="/dev/sdh"/>
Aug 15 02:18:13 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:18:13 user nova-compute[73121]:   <serial>d181e562-7fb8-4ee8-b566-6c34e668639a</serial>
Aug 15 02:18:13 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:18:13 user nova-compute[73121]: </disk>
Aug 15 02:18:13 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065894.1853206, 9bfaa36f-2822-47de-8d12-823e38b4aae4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bfaa36f-2822-47de-8d12-823e38b4aae4 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:18:14 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully detached device vdb from instance 9bfaa36f-2822-47de-8d12-823e38b4aae4 from the live domain config.
Aug 15 02:18:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zhxQlaBT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:18:14 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0bbbaa-6c45-4ade-9c01-d0a1d640e623]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[13994d43-041f-4d03-bcfb-bae496f91a4e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a (non-flash)
Aug 15 02:18:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:14 user nova-compute[73121]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a (non-flash)
Aug 15 02:18:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc78acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a'): ({'sdh'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Removing single pathed devices sdh {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ee2bd2-706b-4eb0-a978-f7bf29053432]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20a7cc8-4e30-413d-ae7d-b66af0eb434b]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Flushing IO for device /dev/sdh {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[65293adb-5049-47f9-86db-7bca943ba220]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[147d4949-7a12-402e-a1e7-2bd122b8e0e1]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] SCSI volumes sdh have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b60abfd-2e25-46b1-a9b0-cdd569b866a0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fbe4ff-db1a-4655-9322-10a22222b2a7]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a, portal: 172.16.0.220,3260]
Aug 15 02:18:14 user nova-compute[73121]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a, portal: 172.16.0.220,3260] successful.
Aug 15 02:18:14 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d181e562-7fb8-4ee8-b566-6c34e668639a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[980294d0-a55e-4629-a723-ca7505a28aa2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] <== disconnect_volume: return (294ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:18:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:18:15 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'flavor' on Instance uuid 9bfaa36f-2822-47de-8d12-823e38b4aae4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:18:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d9ec6762-aaf2-4b41-af50-dd35f0ad3bcc tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.650s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "d7950f28-0893-49de-a560-bbc0791492b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d7950f28-0893-49de-a560-bbc0791492b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "d7950f28-0893-49de-a560-bbc0791492b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:15 user nova-compute[73121]: INFO nova.compute.manager [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Terminating instance
Aug 15 02:18:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:18:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-3f4fe168-bda1-490f-ad7a-bd744d542548 req-da6d3247-3704-4352-a39c-8c80a77d21dc service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received event network-vif-unplugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3f4fe168-bda1-490f-ad7a-bd744d542548 req-da6d3247-3704-4352-a39c-8c80a77d21dc service nova] Acquiring lock "d7950f28-0893-49de-a560-bbc0791492b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3f4fe168-bda1-490f-ad7a-bd744d542548 req-da6d3247-3704-4352-a39c-8c80a77d21dc service nova] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3f4fe168-bda1-490f-ad7a-bd744d542548 req-da6d3247-3704-4352-a39c-8c80a77d21dc service nova] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-3f4fe168-bda1-490f-ad7a-bd744d542548 req-da6d3247-3704-4352-a39c-8c80a77d21dc service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] No waiting events found dispatching network-vif-unplugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-3f4fe168-bda1-490f-ad7a-bd744d542548 req-da6d3247-3704-4352-a39c-8c80a77d21dc service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received event network-vif-unplugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Instance destroyed successfully.
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.objects.instance [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'resources' on Instance uuid d7950f28-0893-49de-a560-bbc0791492b5 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:08:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1502701635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1502701635',id=24,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:08:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-p8igmncs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:10:50Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=d7950f28-0893-49de-a560-bbc0791492b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "address": "fa:16:3e:18:68:29", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79ad6fe2-21", "ovs_interfaceid": "79ad6fe2-2174-4a53-a32d-2c4d306b9e24", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:68:29,bridge_name='br-int',has_traffic_filtering=True,id=79ad6fe2-2174-4a53-a32d-2c4d306b9e24,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ad6fe2-21') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG os_vif [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:68:29,bridge_name='br-int',has_traffic_filtering=True,id=79ad6fe2-2174-4a53-a32d-2c4d306b9e24,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ad6fe2-21') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79ad6fe2-21, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:16 user nova-compute[73121]: INFO os_vif [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:68:29,bridge_name='br-int',has_traffic_filtering=True,id=79ad6fe2-2174-4a53-a32d-2c4d306b9e24,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79ad6fe2-21')
Aug 15 02:18:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Deleting instance files /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5_del
Aug 15 02:18:16 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Deletion of /opt/stack/data/nova/instances/d7950f28-0893-49de-a560-bbc0791492b5_del complete
Aug 15 02:18:16 user nova-compute[73121]: INFO nova.compute.manager [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 15 02:18:16 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d7950f28-0893-49de-a560-bbc0791492b5] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lazy-loading 'flavor' on Instance uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f4e15780-7f32-4d1f-9737-b790888ec3e1 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.571s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:16 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:18:17 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Took 0.56 seconds to deallocate network for instance.
Aug 15 02:18:17 user nova-compute[73121]: DEBUG nova.compute.manager [req-96ecb439-b462-4f80-9e7f-eb54ee87a9aa req-751628ad-ac21-4c98-8a2c-477c9de200de service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received event network-vif-deleted-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:17 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:18:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:18:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.515s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:17 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Deleted allocations for instance d7950f28-0893-49de-a560-bbc0791492b5
Aug 15 02:18:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-195e9f28-e698-4383-a3d4-809dfdd0094b tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "d7950f28-0893-49de-a560-bbc0791492b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.994s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-b24a4c68-47e4-43f4-a876-4c4483200eba req-59710f31-735c-4662-947f-009dd8f14ac4 service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received event network-vif-plugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b24a4c68-47e4-43f4-a876-4c4483200eba req-59710f31-735c-4662-947f-009dd8f14ac4 service nova] Acquiring lock "d7950f28-0893-49de-a560-bbc0791492b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b24a4c68-47e4-43f4-a876-4c4483200eba req-59710f31-735c-4662-947f-009dd8f14ac4 service nova] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b24a4c68-47e4-43f4-a876-4c4483200eba req-59710f31-735c-4662-947f-009dd8f14ac4 service nova] Lock "d7950f28-0893-49de-a560-bbc0791492b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-b24a4c68-47e4-43f4-a876-4c4483200eba req-59710f31-735c-4662-947f-009dd8f14ac4 service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] No waiting events found dispatching network-vif-plugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:18:18 user nova-compute[73121]: WARNING nova.compute.manager [req-b24a4c68-47e4-43f4-a876-4c4483200eba req-59710f31-735c-4662-947f-009dd8f14ac4 service nova] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Received unexpected event network-vif-plugged-79ad6fe2-2174-4a53-a32d-2c4d306b9e24 for instance with vm_state deleted and task_state None.
Aug 15 02:18:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:22 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:18:26 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:27 user nova-compute[73121]: INFO nova.compute.manager [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Detaching volume 5eba0910-dcc9-48bf-a566-4bee0d0caa13
Aug 15 02:18:27 user nova-compute[73121]: INFO nova.virt.block_device [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Attempting to driver detach volume 5eba0910-dcc9-48bf-a566-4bee0d0caa13 from mountpoint /dev/vdb
Aug 15 02:18:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Attempting to detach device vdb from instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:18:27 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:18:27 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:18:27 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:18:27 user nova-compute[73121]:   <serial>5eba0910-dcc9-48bf-a566-4bee0d0caa13</serial>
Aug 15 02:18:27 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:18:27 user nova-compute[73121]: </disk>
Aug 15 02:18:27 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:18:27 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Successfully detached device vdb from instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371 from the persistent domain config.
Aug 15 02:18:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:18:27 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:18:27 user nova-compute[73121]:   <source dev="/dev/sdd"/>
Aug 15 02:18:27 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:18:27 user nova-compute[73121]:   <serial>5eba0910-dcc9-48bf-a566-4bee0d0caa13</serial>
Aug 15 02:18:27 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:18:27 user nova-compute[73121]: </disk>
Aug 15 02:18:27 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065907.7837439, 2dd8fa27-d069-4e43-9789-34ec3ed2d371 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:18:27 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Successfully detached device vdb from instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371 from the live domain config.
Aug 15 02:18:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMgWyfCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:18:27 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9315acb7-c1cd-4c14-899e-340dc88c8ca2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07970ea2-0b79-481f-91a3-da02369d2c24]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:27 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:27 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:27 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:27 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:27 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:27 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:27 user nova-compute[73121]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 (non-flash)
Aug 15 02:18:27 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:27 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:27 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc648dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13'): ({'sdd'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Removing single pathed devices sdd {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8adaf8-1ee7-4c85-9815-2601951db770]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[143a4900-1696-4a8f-b866-a65c34fdf2ce]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Flushing IO for device /dev/sdd {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2d689e-9a76-4a22-b71d-3cb813323a28]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66f30f8-d994-43cd-9d7c-f03f5e2c1073]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2820d98a-c955-4083-83a5-038d468eb002]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d02667e-db6c-40fe-91cb-cf62492d79ac]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13, portal: 172.16.0.220,3260]
Aug 15 02:18:28 user nova-compute[73121]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13, portal: 172.16.0.220,3260] successful.
Aug 15 02:18:28 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c304055-41d4-4533-a515-3aebafbdb6c7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] <== disconnect_volume: return (292ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG nova.objects.instance [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'flavor' on Instance uuid 2dd8fa27-d069-4e43-9789-34ec3ed2d371 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-bfdb6913-c716-4af2-9662-c464282a3418 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.625s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.497s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:28 user nova-compute[73121]: INFO nova.compute.manager [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Terminating instance
Aug 15 02:18:28 user nova-compute[73121]: DEBUG nova.compute.manager [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-d1681c90-b03e-4ecc-a326-4713060d0e83 req-5fde721e-a66c-497b-841c-f84747aa2181 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received event network-vif-unplugged-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d1681c90-b03e-4ecc-a326-4713060d0e83 req-5fde721e-a66c-497b-841c-f84747aa2181 service nova] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d1681c90-b03e-4ecc-a326-4713060d0e83 req-5fde721e-a66c-497b-841c-f84747aa2181 service nova] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d1681c90-b03e-4ecc-a326-4713060d0e83 req-5fde721e-a66c-497b-841c-f84747aa2181 service nova] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-d1681c90-b03e-4ecc-a326-4713060d0e83 req-5fde721e-a66c-497b-841c-f84747aa2181 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] No waiting events found dispatching network-vif-unplugged-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-d1681c90-b03e-4ecc-a326-4713060d0e83 req-5fde721e-a66c-497b-841c-f84747aa2181 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received event network-vif-unplugged-a1458fef-0602-4e19-8e52-c608a485e25f for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:18:29 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Instance destroyed successfully.
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'resources' on Instance uuid 2dd8fa27-d069-4e43-9789-34ec3ed2d371 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:15:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1417648587',display_name='tempest-VolumesSnapshotTestJSON-instance-1417648587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1417648587',id=33,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/JcAH98IJIVveVqI5dxaiwuiy7WUydF2dwuXcvQq/VVeOhLzujP0GnrUUOoJEb+hF32EQhlFjOE9/9MZfz7f2sbZsP5xIRY+3azX9dzTlj5mxU5RIX9jppagyGA+oMCQ==',key_name='tempest-keypair-1385308009',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:15:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7093d5ade03430488a4713acba49588',ramdisk_id='',reservation_id='r-ke400qh6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1030319394',owner_user_name='tempest-VolumesSnapshotTestJSON-1030319394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:15:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f199d32620e4c0d9d48b9737d2f8f23',uuid=2dd8fa27-d069-4e43-9789-34ec3ed2d371,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converting VIF {"id": "a1458fef-0602-4e19-8e52-c608a485e25f", "address": "fa:16:3e:15:b1:68", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1458fef-06", "ovs_interfaceid": "a1458fef-0602-4e19-8e52-c608a485e25f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=a1458fef-0602-4e19-8e52-c608a485e25f,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1458fef-06') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_vif [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=a1458fef-0602-4e19-8e52-c608a485e25f,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1458fef-06') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1458fef-06, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:29 user nova-compute[73121]: INFO os_vif [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:b1:68,bridge_name='br-int',has_traffic_filtering=True,id=a1458fef-0602-4e19-8e52-c608a485e25f,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1458fef-06')
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KMgWyfCl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:18:29 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5eba0910-dcc9-48bf-a566-4bee0d0caa13', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[53702846-c668-41c5-acbe-aad2b05aa6eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e17fde03-3fc0-4440-b3b4-040c169078c5]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:29 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:29 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:29 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:29 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:18:29 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:18:29 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:18:29 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:18:29 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc60e7a0>, {}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Disconnecting from: [] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] <== disconnect_volume: return (55ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:18:29 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Deleting instance files /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371_del
Aug 15 02:18:29 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Deletion of /opt/stack/data/nova/instances/2dd8fa27-d069-4e43-9789-34ec3ed2d371_del complete
Aug 15 02:18:29 user nova-compute[73121]: INFO nova.compute.manager [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 02:18:29 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:18:29 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:18:30 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:18:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-826b2f00-f1f2-43c3-b430-4082f40f45fa req-fb58c9c7-b8f4-43e9-9757-172709ad27a7 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received event network-vif-deleted-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:30 user nova-compute[73121]: INFO nova.compute.manager [req-826b2f00-f1f2-43c3-b430-4082f40f45fa req-fb58c9c7-b8f4-43e9-9757-172709ad27a7 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Neutron deleted interface a1458fef-0602-4e19-8e52-c608a485e25f; detaching it from the instance and deleting it from the info cache
Aug 15 02:18:30 user nova-compute[73121]: DEBUG nova.network.neutron [req-826b2f00-f1f2-43c3-b430-4082f40f45fa req-fb58c9c7-b8f4-43e9-9757-172709ad27a7 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:18:30 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Took 0.88 seconds to deallocate network for instance.
Aug 15 02:18:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-826b2f00-f1f2-43c3-b430-4082f40f45fa req-fb58c9c7-b8f4-43e9-9757-172709ad27a7 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Detach interface failed, port_id=a1458fef-0602-4e19-8e52-c608a485e25f, reason: Instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:18:30 user nova-compute[73121]: WARNING nova.volume.cinder [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Attachment 6956bece-3deb-4a79-835d-cc4adfcfc867 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6956bece-3deb-4a79-835d-cc4adfcfc867. (HTTP 404) (Request-ID: req-73bc67bd-6035-45d3-97a2-5132a55a027e)
Aug 15 02:18:30 user nova-compute[73121]: INFO nova.compute.manager [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Took 0.02 seconds to detach 1 volumes for instance.
Aug 15 02:18:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:31 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Deleted allocations for instance 2dd8fa27-d069-4e43-9789-34ec3ed2d371
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-efa811be-d570-4b6c-92b1-25e274875fc4 req-e689c58e-a839-45e6-b398-5109357a9e72 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received event network-vif-plugged-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-efa811be-d570-4b6c-92b1-25e274875fc4 req-e689c58e-a839-45e6-b398-5109357a9e72 service nova] Acquiring lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-efa811be-d570-4b6c-92b1-25e274875fc4 req-e689c58e-a839-45e6-b398-5109357a9e72 service nova] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-efa811be-d570-4b6c-92b1-25e274875fc4 req-e689c58e-a839-45e6-b398-5109357a9e72 service nova] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG nova.compute.manager [req-efa811be-d570-4b6c-92b1-25e274875fc4 req-e689c58e-a839-45e6-b398-5109357a9e72 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] No waiting events found dispatching network-vif-plugged-a1458fef-0602-4e19-8e52-c608a485e25f {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:18:31 user nova-compute[73121]: WARNING nova.compute.manager [req-efa811be-d570-4b6c-92b1-25e274875fc4 req-e689c58e-a839-45e6-b398-5109357a9e72 service nova] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Received unexpected event network-vif-plugged-a1458fef-0602-4e19-8e52-c608a485e25f for instance with vm_state deleted and task_state None.
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7ed5d8f3-5410-4acc-beee-4f0498346b75 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "2dd8fa27-d069-4e43-9789-34ec3ed2d371" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.327s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065896.2919266, d7950f28-0893-49de-a560-bbc0791492b5 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:18:31 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d7950f28-0893-49de-a560-bbc0791492b5] VM Stopped (Lifecycle Event)
Aug 15 02:18:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-8a01cc5d-d800-41a1-a4eb-c03a555b58a9 None None] [instance: d7950f28-0893-49de-a560-bbc0791492b5] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:18:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-5d59a58b-64e6-4c53-ba5d-95932ebe3a07 req-4e3be921-4d52-4180-a344-c25ad7f6954d service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-changed-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-5d59a58b-64e6-4c53-ba5d-95932ebe3a07 req-4e3be921-4d52-4180-a344-c25ad7f6954d service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Refreshing instance network info cache due to event network-changed-a6084f1b-a315-4de8-a572-5cf33a871c66. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5d59a58b-64e6-4c53-ba5d-95932ebe3a07 req-4e3be921-4d52-4180-a344-c25ad7f6954d service nova] Acquiring lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5d59a58b-64e6-4c53-ba5d-95932ebe3a07 req-4e3be921-4d52-4180-a344-c25ad7f6954d service nova] Acquired lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-5d59a58b-64e6-4c53-ba5d-95932ebe3a07 req-4e3be921-4d52-4180-a344-c25ad7f6954d service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Refreshing network info cache for port a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:18:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:18:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7294MB free_disk=25.221763610839844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1145ac04-f2f8-49d3-a54e-365f7269d8be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 9bfaa36f-2822-47de-8d12-823e38b4aae4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 454e5897-0179-41fb-a58d-c264831ee4a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 02572d81-b687-48ca-bb93-cedebe076fdf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-5d59a58b-64e6-4c53-ba5d-95932ebe3a07 req-4e3be921-4d52-4180-a344-c25ad7f6954d service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updated VIF entry in instance network info cache for port a6084f1b-a315-4de8-a572-5cf33a871c66. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-5d59a58b-64e6-4c53-ba5d-95932ebe3a07 req-4e3be921-4d52-4180-a344-c25ad7f6954d service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating instance_info_cache with network_info: [{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5d59a58b-64e6-4c53-ba5d-95932ebe3a07 req-4e3be921-4d52-4180-a344-c25ad7f6954d service nova] Releasing lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:18:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:18:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:40 user nova-compute[73121]: INFO nova.compute.manager [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Shelving
Aug 15 02:18:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-28810197-77b9-4011-bbd2-8eb08e1ac6ae req-c159f34c-3de2-4573-8a4e-6ff70a5585b8 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-unplugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-28810197-77b9-4011-bbd2-8eb08e1ac6ae req-c159f34c-3de2-4573-8a4e-6ff70a5585b8 service nova] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-28810197-77b9-4011-bbd2-8eb08e1ac6ae req-c159f34c-3de2-4573-8a4e-6ff70a5585b8 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-28810197-77b9-4011-bbd2-8eb08e1ac6ae req-c159f34c-3de2-4573-8a4e-6ff70a5585b8 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-28810197-77b9-4011-bbd2-8eb08e1ac6ae req-c159f34c-3de2-4573-8a4e-6ff70a5585b8 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] No waiting events found dispatching network-vif-unplugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:18:40 user nova-compute[73121]: WARNING nova.compute.manager [req-28810197-77b9-4011-bbd2-8eb08e1ac6ae req-c159f34c-3de2-4573-8a4e-6ff70a5585b8 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received unexpected event network-vif-unplugged-a6084f1b-a315-4de8-a572-5cf33a871c66 for instance with vm_state active and task_state shelving.
Aug 15 02:18:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:41 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance destroyed successfully.
Aug 15 02:18:41 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Beginning cold snapshot process
Aug 15 02:18:41 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:18:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk /opt/stack/data/nova/instances/snapshots/tmptannloeh/3cbca7f0322943ce99cc35dc269179ae {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:18:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk /opt/stack/data/nova/instances/snapshots/tmptannloeh/3cbca7f0322943ce99cc35dc269179ae" returned: 0 in 1.065s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:18:42 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Snapshot extracted, beginning image upload
Aug 15 02:18:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1bf50098-19c8-45c6-a9cc-2882d4e8ba32 req-bde27058-44ea-49ed-84f9-3d9b612fd479 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1bf50098-19c8-45c6-a9cc-2882d4e8ba32 req-bde27058-44ea-49ed-84f9-3d9b612fd479 service nova] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1bf50098-19c8-45c6-a9cc-2882d4e8ba32 req-bde27058-44ea-49ed-84f9-3d9b612fd479 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1bf50098-19c8-45c6-a9cc-2882d4e8ba32 req-bde27058-44ea-49ed-84f9-3d9b612fd479 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-1bf50098-19c8-45c6-a9cc-2882d4e8ba32 req-bde27058-44ea-49ed-84f9-3d9b612fd479 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] No waiting events found dispatching network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:18:42 user nova-compute[73121]: WARNING nova.compute.manager [req-1bf50098-19c8-45c6-a9cc-2882d4e8ba32 req-bde27058-44ea-49ed-84f9-3d9b612fd479 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received unexpected event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 02:18:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:44 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065909.6174047, 2dd8fa27-d069-4e43-9789-34ec3ed2d371 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:18:44 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] VM Stopped (Lifecycle Event)
Aug 15 02:18:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d2a1e2c9-9ebe-4481-bcf3-3a303b25ef0f None None] [instance: 2dd8fa27-d069-4e43-9789-34ec3ed2d371] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:18:44 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Snapshot image upload complete
Aug 15 02:18:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:18:44 user nova-compute[73121]: INFO nova.compute.manager [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Shelve offloading
Aug 15 02:18:44 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance destroyed successfully.
Aug 15 02:18:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:18:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:18:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquired lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:18:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG nova.network.neutron [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating instance_info_cache with network_info: [{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Releasing lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:18:45 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance destroyed successfully.
Aug 15 02:18:45 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'resources' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-999784560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-999784560',id=36,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+vKc3yQUIiUeKk+6SqAfOnm7qoBAZhutX2WfEyQ8T7/hQuhg0kOVlZkj8Jg8z3zk8TDB4cIPXK1r6sq0Pvl9/gFMUh98L6bG9QYSc/d2ypUPKtISfwLWz1D/q+9IoS4g==',key_name='tempest-keypair-307324577',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-4snqcx1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member',shelved_at='2023-08-15T02:18:44.727053',shelved_host='user',shelved_image_id='d631529d-3cbf-4b30-b8cc-d2a467df71b0'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:18:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG os_vif [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6084f1b-a3, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:18:45 user nova-compute[73121]: INFO os_vif [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3')
Aug 15 02:18:45 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Deleting instance files /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7_del
Aug 15 02:18:45 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Deletion of /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7_del complete
Aug 15 02:18:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-1c633c86-013b-4fea-8c6b-adcd7e90554b req-143567e0-f9ca-4eca-a1f4-813acdc8debe service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-changed-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-1c633c86-013b-4fea-8c6b-adcd7e90554b req-143567e0-f9ca-4eca-a1f4-813acdc8debe service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Refreshing instance network info cache due to event network-changed-a6084f1b-a315-4de8-a572-5cf33a871c66. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1c633c86-013b-4fea-8c6b-adcd7e90554b req-143567e0-f9ca-4eca-a1f4-813acdc8debe service nova] Acquiring lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1c633c86-013b-4fea-8c6b-adcd7e90554b req-143567e0-f9ca-4eca-a1f4-813acdc8debe service nova] Acquired lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:18:45 user nova-compute[73121]: DEBUG nova.network.neutron [req-1c633c86-013b-4fea-8c6b-adcd7e90554b req-143567e0-f9ca-4eca-a1f4-813acdc8debe service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Refreshing network info cache for port a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:18:46 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Deleted allocations for instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7
Aug 15 02:18:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:18:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:18:46 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'numa_topology' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:18:46 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:18:46 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:18:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d90891cf-fe8d-4358-8f18-afef13c91f23 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.360s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:18:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-1c633c86-013b-4fea-8c6b-adcd7e90554b req-143567e0-f9ca-4eca-a1f4-813acdc8debe service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updated VIF entry in instance network info cache for port a6084f1b-a315-4de8-a572-5cf33a871c66. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:18:46 user nova-compute[73121]: DEBUG nova.network.neutron [req-1c633c86-013b-4fea-8c6b-adcd7e90554b req-143567e0-f9ca-4eca-a1f4-813acdc8debe service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating instance_info_cache with network_info: [{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:18:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1c633c86-013b-4fea-8c6b-adcd7e90554b req-143567e0-f9ca-4eca-a1f4-813acdc8debe service nova] Releasing lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:18:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:18:56 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065921.018462, 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:18:56 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] VM Stopped (Lifecycle Event)
Aug 15 02:18:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d9dd5018-5f31-4898-b7e5-4cd62741acdb None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-a33d4e70-ca7a-40c8-b64b-cb5316b114e1 req-231661ba-4b85-43a9-8cd2-a776ac329257 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received event network-changed-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-a33d4e70-ca7a-40c8-b64b-cb5316b114e1 req-231661ba-4b85-43a9-8cd2-a776ac329257 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Refreshing instance network info cache due to event network-changed-3ce335a5-d497-4e7a-ac6f-0e281c42cafb. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:19:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a33d4e70-ca7a-40c8-b64b-cb5316b114e1 req-231661ba-4b85-43a9-8cd2-a776ac329257 service nova] Acquiring lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a33d4e70-ca7a-40c8-b64b-cb5316b114e1 req-231661ba-4b85-43a9-8cd2-a776ac329257 service nova] Acquired lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:01 user nova-compute[73121]: DEBUG nova.network.neutron [req-a33d4e70-ca7a-40c8-b64b-cb5316b114e1 req-231661ba-4b85-43a9-8cd2-a776ac329257 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Refreshing network info cache for port 3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:19:02 user nova-compute[73121]: DEBUG nova.network.neutron [req-a33d4e70-ca7a-40c8-b64b-cb5316b114e1 req-231661ba-4b85-43a9-8cd2-a776ac329257 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updated VIF entry in instance network info cache for port 3ce335a5-d497-4e7a-ac6f-0e281c42cafb. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:19:02 user nova-compute[73121]: DEBUG nova.network.neutron [req-a33d4e70-ca7a-40c8-b64b-cb5316b114e1 req-231661ba-4b85-43a9-8cd2-a776ac329257 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a33d4e70-ca7a-40c8-b64b-cb5316b114e1 req-231661ba-4b85-43a9-8cd2-a776ac329257 service nova] Releasing lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:02 user nova-compute[73121]: INFO nova.compute.manager [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Detaching volume 3db6dd64-1618-4f1d-a35a-3011a4155612
Aug 15 02:19:02 user nova-compute[73121]: INFO nova.virt.block_device [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Attempting to driver detach volume 3db6dd64-1618-4f1d-a35a-3011a4155612 from mountpoint /dev/vdb
Aug 15 02:19:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Attempting to detach device vdb from instance 1145ac04-f2f8-49d3-a54e-365f7269d8be from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:19:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:19:02 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:19:02 user nova-compute[73121]:   <source dev="/dev/sdf"/>
Aug 15 02:19:02 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:19:02 user nova-compute[73121]:   <serial>3db6dd64-1618-4f1d-a35a-3011a4155612</serial>
Aug 15 02:19:02 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:19:02 user nova-compute[73121]: </disk>
Aug 15 02:19:02 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:19:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Successfully detached device vdb from instance 1145ac04-f2f8-49d3-a54e-365f7269d8be from the persistent domain config.
Aug 15 02:19:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1145ac04-f2f8-49d3-a54e-365f7269d8be from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:19:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:19:02 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:19:02 user nova-compute[73121]:   <source dev="/dev/sdf"/>
Aug 15 02:19:02 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:19:02 user nova-compute[73121]:   <serial>3db6dd64-1618-4f1d-a35a-3011a4155612</serial>
Aug 15 02:19:02 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:19:02 user nova-compute[73121]: </disk>
Aug 15 02:19:02 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692065943.0428054, 1145ac04-f2f8-49d3-a54e-365f7269d8be => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:19:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Successfully detached device vdb from instance 1145ac04-f2f8-49d3-a54e-365f7269d8be from the live domain config.
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZRYewPtU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:19:03 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cbb25c-b367-429a-9fef-c24877dbd416]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad63f3d-c0d3-4778-9734-10d9eea0aa4e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:19:03 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:03 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:19:03 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:19:03 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:19:03 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:03 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:19:03 user nova-compute[73121]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 (non-flash)
Aug 15 02:19:03 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e203795a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612'): ({'sdf'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Removing single pathed devices sdf {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fdfaa6-5f9a-4b8f-88dc-763311ef4f80]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[907e1d3d-d4c6-4251-97e6-4d5393d7fca1]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Flushing IO for device /dev/sdf {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee62ae8-cf19-490b-8bfd-645ce601a624]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9fb168-39f2-4cad-9813-17dec7b9ca2f]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] SCSI volumes sdf have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a4f3c4-3927-4091-8088-04a8d5a0e31c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf3458-7c74-4c0f-a0b6-b13386f075b3]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612, portal: 172.16.0.220,3260]
Aug 15 02:19:03 user nova-compute[73121]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612, portal: 172.16.0.220,3260] successful.
Aug 15 02:19:03 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3db6dd64-1618-4f1d-a35a-3011a4155612 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a549f0-2917-4af4-b132-c7e9219cdbed]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] <== disconnect_volume: return (300ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Stashing vm_state: active {{(pid=73121) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-6023a9dc-86ba-4799-8fe2-d6ce0d1f31e7 req-4cf2deb1-7cc0-48af-bd8e-45ba2a3e6e49 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-changed-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-6023a9dc-86ba-4799-8fe2-d6ce0d1f31e7 req-4cf2deb1-7cc0-48af-bd8e-45ba2a3e6e49 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Refreshing instance network info cache due to event network-changed-7c725b88-d99b-4290-b3e7-6152fb3432ee. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6023a9dc-86ba-4799-8fe2-d6ce0d1f31e7 req-4cf2deb1-7cc0-48af-bd8e-45ba2a3e6e49 service nova] Acquiring lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6023a9dc-86ba-4799-8fe2-d6ce0d1f31e7 req-4cf2deb1-7cc0-48af-bd8e-45ba2a3e6e49 service nova] Acquired lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.network.neutron [req-6023a9dc-86ba-4799-8fe2-d6ce0d1f31e7 req-4cf2deb1-7cc0-48af-bd8e-45ba2a3e6e49 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Refreshing network info cache for port 7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'pci_requests' on Instance uuid 454e5897-0179-41fb-a58d-c264831ee4a9 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:19:03 user nova-compute[73121]: INFO nova.compute.claims [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Claim successful on node user
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'resources' on Instance uuid 454e5897-0179-41fb-a58d-c264831ee4a9 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'pci_devices' on Instance uuid 454e5897-0179-41fb-a58d-c264831ee4a9 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:03 user nova-compute[73121]: INFO nova.compute.resource_tracker [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating resource usage from migration 99d635e8-969e-4c08-b8c7-eba1f02508c6
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:03 user nova-compute[73121]: INFO nova.compute.manager [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Terminating instance
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.objects.instance [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lazy-loading 'flavor' on Instance uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cf0311d4-b3f4-4841-86b4-8f7bf7202150 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.728s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.508s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:04 user nova-compute[73121]: INFO nova.compute.manager [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Migrating
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.network.neutron [req-6023a9dc-86ba-4799-8fe2-d6ce0d1f31e7 req-4cf2deb1-7cc0-48af-bd8e-45ba2a3e6e49 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updated VIF entry in instance network info cache for port 7c725b88-d99b-4290-b3e7-6152fb3432ee. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.network.neutron [req-6023a9dc-86ba-4799-8fe2-d6ce0d1f31e7 req-4cf2deb1-7cc0-48af-bd8e-45ba2a3e6e49 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating instance_info_cache with network_info: [{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:04 user nova-compute[73121]: INFO nova.compute.rpcapi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6023a9dc-86ba-4799-8fe2-d6ce0d1f31e7 req-4cf2deb1-7cc0-48af-bd8e-45ba2a3e6e49 service nova] Releasing lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquired lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-bd1268b3-c87f-4e6f-a795-de9cc87dbdf5 req-1d843947-8e1b-4af9-8ed9-af7ab98812c7 service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received event network-vif-unplugged-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bd1268b3-c87f-4e6f-a795-de9cc87dbdf5 req-1d843947-8e1b-4af9-8ed9-af7ab98812c7 service nova] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bd1268b3-c87f-4e6f-a795-de9cc87dbdf5 req-1d843947-8e1b-4af9-8ed9-af7ab98812c7 service nova] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bd1268b3-c87f-4e6f-a795-de9cc87dbdf5 req-1d843947-8e1b-4af9-8ed9-af7ab98812c7 service nova] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-bd1268b3-c87f-4e6f-a795-de9cc87dbdf5 req-1d843947-8e1b-4af9-8ed9-af7ab98812c7 service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] No waiting events found dispatching network-vif-unplugged-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-bd1268b3-c87f-4e6f-a795-de9cc87dbdf5 req-1d843947-8e1b-4af9-8ed9-af7ab98812c7 service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received event network-vif-unplugged-b77ab60c-66e8-4d0e-998d-86d6053a465d for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:19:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Instance destroyed successfully.
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.objects.instance [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lazy-loading 'resources' on Instance uuid 9bfaa36f-2822-47de-8d12-823e38b4aae4 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:15:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1891893581',display_name='tempest-AttachVolumeNegativeTest-server-1891893581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1891893581',id=35,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHuPSTHran1OJuZTKPhq9DUWJ5q5PF/VW/rGRkkhuoTSBMcGTILIMxsB/1PAoyCflltQMhMG34MRjM9QmDj1En1bG5d4XxbmZKp6cHLZwB5+pe8yT4ZySe9H/QscJ5ldjw==',key_name='tempest-keypair-1104148254',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:16:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcc744b107dc4a8baa3274788b094e2d',ramdisk_id='',reservation_id='r-3xvux490',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2069847524',owner_user_name='tempest-AttachVolumeNegativeTest-2069847524-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:16:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c1e20e779ac4711803956ee2a2accaa',uuid=9bfaa36f-2822-47de-8d12-823e38b4aae4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converting VIF {"id": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "address": "fa:16:3e:7a:9a:fb", "network": {"id": "853113c5-9293-43bd-804a-7ef12ceba89b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-608285514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.191", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcc744b107dc4a8baa3274788b094e2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb77ab60c-66", "ovs_interfaceid": "b77ab60c-66e8-4d0e-998d-86d6053a465d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:9a:fb,bridge_name='br-int',has_traffic_filtering=True,id=b77ab60c-66e8-4d0e-998d-86d6053a465d,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77ab60c-66') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG os_vif [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:9a:fb,bridge_name='br-int',has_traffic_filtering=True,id=b77ab60c-66e8-4d0e-998d-86d6053a465d,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77ab60c-66') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb77ab60c-66, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:04 user nova-compute[73121]: INFO os_vif [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:9a:fb,bridge_name='br-int',has_traffic_filtering=True,id=b77ab60c-66e8-4d0e-998d-86d6053a465d,network=Network(853113c5-9293-43bd-804a-7ef12ceba89b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb77ab60c-66')
Aug 15 02:19:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Deleting instance files /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4_del
Aug 15 02:19:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Deletion of /opt/stack/data/nova/instances/9bfaa36f-2822-47de-8d12-823e38b4aae4_del complete
Aug 15 02:19:04 user nova-compute[73121]: INFO nova.compute.manager [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 02:19:04 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:19:04 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating instance_info_cache with network_info: [{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Releasing lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Starting migrate_disk_and_power_off {{(pid=73121) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "02572d81-b687-48ca-bb93-cedebe076fdf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "02572d81-b687-48ca-bb93-cedebe076fdf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:05 user nova-compute[73121]: INFO nova.compute.manager [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Terminating instance
Aug 15 02:19:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:05 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:05 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Took 1.09 seconds to deallocate network for instance.
Aug 15 02:19:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-110ea08c-41df-480d-8181-3bc2a6be36cb req-23e4f88b-8012-4261-8508-1315a6a5bcb7 service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received event network-vif-deleted-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Instance destroyed successfully.
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2101332850',display_name='tempest-ServerActionsTestOtherA-server-2101332850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2101332850',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdD9feBUtKJxWabCOxeEfVUYblkUx99maantL29ickzkNiSka7JcOd7LAkLzENREY7q67OdhUq5n4xklCuCa82bJF6NH8tngV7k73jmjSgmnNbURsM8zWbxOgcKQEI/Q==',key_name='tempest-keypair-556442797',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-1c2cui6c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=454e5897-0179-41fb-a58d-c264831ee4a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1247729830-network", "vif_mac": "fa:16:3e:b8:12:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1247729830-network", "vif_mac": "fa:16:3e:b8:12:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_vif [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c725b88-d9, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:06 user nova-compute[73121]: INFO os_vif [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9')
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdtmejLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:19:06 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a7ccad-8298-4208-bcc4-40108f2bc548]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ae2d83-c942-4d2e-b4dd-d343b0d8b521]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:19:06 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:06 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:19:06 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:19:06 user nova-compute[73121]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:06 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:19:06 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc6496c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12e57f1-72bf-47fe-b62d-d33567dff55e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.053s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[039236dd-265c-4eae-a3e0-5449f83fde22]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33f100d-b898-4126-8e55-b8dba81a38e1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9451b198-a8a5-4a2f-8264-b2be7d37ac40]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_ab8eb72c', '/dev/disk/by-id/scsi-1SCST_BIOab8eb72c-72803cb83fa2b0ab', '/dev/disk/by-id/scsi-23732383033636238') {{(pid=84043) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fb49c8-db4b-43a7-9740-0fcc22f971f5]: (4, None) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0728a8ff-e4e4-49bf-8ab1-96e05383cb22]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b07172-7527-4e3a-bdd1-4abcd9eace91]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260]
Aug 15 02:19:06 user nova-compute[73121]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260] successful.
Aug 15 02:19:06 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6b7f03-e1fa-4e48-9389-787e5aa2c80a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== disconnect_volume: return (415ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:06 user nova-compute[73121]: INFO nova.compute.manager [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Terminating instance
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:19:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Instance destroyed successfully.
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.objects.instance [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'resources' on Instance uuid 02572d81-b687-48ca-bb93-cedebe076fdf {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-775591186',display_name='tempest-TestVolumeBootPattern-server-775591186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-775591186',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuKaje8XOyRteWQDYhsHPlBp1Xjeq99eSrwstRwpVv8kz+qsXnyj4MM3934HkKDRT/PtguSeoZK5bF8tR96SJXazwgYAgV+WiBSzEqWb7KFKLbBhYz1ys01ett7El1jYw==',key_name='tempest-TestVolumeBootPattern-929875393',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:17:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-zqrs9z8d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:17:41Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=02572d81-b687-48ca-bb93-cedebe076fdf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=297d9181-5888-4728-8b38-39fbe97d0992,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297d9181-58') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_vif [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=297d9181-5888-4728-8b38-39fbe97d0992,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297d9181-58') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap297d9181-58, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.577s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:06 user nova-compute[73121]: INFO os_vif [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:49:d0,bridge_name='br-int',has_traffic_filtering=True,id=297d9181-5888-4728-8b38-39fbe97d0992,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap297d9181-58')
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvzRfCyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:19:06 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b387ea9f-9edc-41d0-997e-5b8fe1cca32d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[302c302a-41b6-4b09-b3d8-53da275d2d3a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:19:06 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:19:06 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:19:06 user nova-compute[73121]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:19:06 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e205d45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d'): ({'sde'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Removing single pathed devices sde {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b0e550-6b81-4798-aea7-1eb744b1cc60]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9700ba12-7f5a-4f01-b3f1-277b5940132c]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flushing IO for device /dev/sde {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Deleted allocations for instance 9bfaa36f-2822-47de-8d12-823e38b4aae4
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d567bc-2fb2-4c6b-aa7e-139cdc027ba5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received event network-vif-plugged-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Acquiring lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] No waiting events found dispatching network-vif-plugged-b77ab60c-66e8-4d0e-998d-86d6053a465d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:06 user nova-compute[73121]: WARNING nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Received unexpected event network-vif-plugged-b77ab60c-66e8-4d0e-998d-86d6053a465d for instance with vm_state deleted and task_state None.
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received event network-changed-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Refreshing instance network info cache due to event network-changed-297d9181-5888-4728-8b38-39fbe97d0992. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Acquiring lock "refresh_cache-02572d81-b687-48ca-bb93-cedebe076fdf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Acquired lock "refresh_cache-02572d81-b687-48ca-bb93-cedebe076fdf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG nova.network.neutron [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Refreshing network info cache for port 297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fc0a08-ada1-45dc-a227-52d40899fc99]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb79ababc-209751dc09e52196', '/dev/disk/by-id/scsi-23230393735316463', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b79ababc') {{(pid=84043) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[041138e7-6076-41ed-81ca-980ffc673908]: (4, None) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb825afe-004b-4245-902b-09d9d0d5f671]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b716fe2d-8067-4bfb-ae83-8e6697c1e967]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260]
Aug 15 02:19:06 user nova-compute[73121]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260] successful.
Aug 15 02:19:06 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86b0736e-0894-428e-a06c-06af8627126b tempest-AttachVolumeNegativeTest-2069847524 tempest-AttachVolumeNegativeTest-2069847524-project-member] Lock "9bfaa36f-2822-47de-8d12-823e38b4aae4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.027s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff51f1e4-4e37-4ad1-9a9a-c09d3d80e315]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== disconnect_volume: return (389ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:19:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Deleting instance files /opt/stack/data/nova/instances/02572d81-b687-48ca-bb93-cedebe076fdf_del
Aug 15 02:19:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Deletion of /opt/stack/data/nova/instances/02572d81-b687-48ca-bb93-cedebe076fdf_del complete
Aug 15 02:19:07 user nova-compute[73121]: INFO nova.compute.manager [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Took 1.53 seconds to destroy the instance on the hypervisor.
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:19:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Instance destroyed successfully.
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.objects.instance [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'resources' on Instance uuid f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:03:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1758480341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1758480341',id=14,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:05:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-75oht42y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:07:06Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "address": "fa:16:3e:c8:62:1b", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap739b4e0a-f6", "ovs_interfaceid": "739b4e0a-f699-4550-8bf7-58935b4c9a18", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:62:1b,bridge_name='br-int',has_traffic_filtering=True,id=739b4e0a-f699-4550-8bf7-58935b4c9a18,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b4e0a-f6') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_vif [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:62:1b,bridge_name='br-int',has_traffic_filtering=True,id=739b4e0a-f699-4550-8bf7-58935b4c9a18,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b4e0a-f6') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap739b4e0a-f6, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:07 user nova-compute[73121]: INFO os_vif [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:62:1b,bridge_name='br-int',has_traffic_filtering=True,id=739b4e0a-f699-4550-8bf7-58935b4c9a18,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap739b4e0a-f6')
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XoqgwLYh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:19:07 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c14f31-f100-4e43-8de6-7ceca27e0755]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[116098b6-74e9-49e9-923f-d1ba1c3cb668]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:19:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 (non-flash)
Aug 15 02:19:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e2040b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e9458e-55f9-48cb-a039-90370a973ae8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[297a90ee-f973-42e9-ab94-83b65d798d43]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a37dc90-d3bd-4fcd-bcfa-9bac6c46cabf]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbd7e71-2885-40c4-86d7-6a62965cb1e0]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.network.neutron [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Updated VIF entry in instance network info cache for port 297d9181-5888-4728-8b38-39fbe97d0992. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.network.neutron [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Updating instance_info_cache with network_info: [{"id": "297d9181-5888-4728-8b38-39fbe97d0992", "address": "fa:16:3e:4e:49:d0", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297d9181-58", "ovs_interfaceid": "297d9181-5888-4728-8b38-39fbe97d0992", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bcef3f-2895-418e-a7da-f1ca412c72e8]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Releasing lock "refresh_cache-02572d81-b687-48ca-bb93-cedebe076fdf" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-unplugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] No waiting events found dispatching network-vif-unplugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:07 user nova-compute[73121]: WARNING nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received unexpected event network-vif-unplugged-7c725b88-d99b-4290-b3e7-6152fb3432ee for instance with vm_state active and task_state resize_migrating.
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] No waiting events found dispatching network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:07 user nova-compute[73121]: WARNING nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received unexpected event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee for instance with vm_state active and task_state resize_migrating.
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received event network-vif-unplugged-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Acquiring lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] No waiting events found dispatching network-vif-unplugged-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received event network-vif-unplugged-297d9181-5888-4728-8b38-39fbe97d0992 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received event network-vif-plugged-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Acquiring lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] Lock "02572d81-b687-48ca-bb93-cedebe076fdf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] No waiting events found dispatching network-vif-plugged-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:07 user nova-compute[73121]: WARNING nova.compute.manager [req-43f5969e-72fd-4799-9836-3a80993b62de req-e80d513e-21c4-4ac5-86f1-1f9889e4c93a service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received unexpected event network-vif-plugged-297d9181-5888-4728-8b38-39fbe97d0992 for instance with vm_state active and task_state deleting.
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eee438f-564a-4426-9797-bc627bd703cc]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0, portal: 172.16.0.220,3260]
Aug 15 02:19:07 user nova-compute[73121]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0, portal: 172.16.0.220,3260] successful.
Aug 15 02:19:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4ec1b1b-8080-462d-8403-a76daf4f42a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9116bc4-2b40-48d2-8077-460608d2d89d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] <== disconnect_volume: return (322ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:19:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Deleting instance files /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845_del
Aug 15 02:19:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Deletion of /opt/stack/data/nova/instances/f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845_del complete
Aug 15 02:19:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:07 user nova-compute[73121]: INFO nova.compute.manager [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 15 02:19:07 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:19:07 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Port 7c725b88-d99b-4290-b3e7-6152fb3432ee binding to destination host user is already ACTIVE {{(pid=73121) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 02:19:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:08 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-29e6baf5-06bb-4226-8e48-7e52980615c2 req-f75a98c9-ad36-4416-904a-79cee392044c service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Received event network-vif-deleted-297d9181-5888-4728-8b38-39fbe97d0992 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:08 user nova-compute[73121]: INFO nova.compute.manager [req-29e6baf5-06bb-4226-8e48-7e52980615c2 req-f75a98c9-ad36-4416-904a-79cee392044c service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Neutron deleted interface 297d9181-5888-4728-8b38-39fbe97d0992; detaching it from the instance and deleting it from the info cache
Aug 15 02:19:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-29e6baf5-06bb-4226-8e48-7e52980615c2 req-f75a98c9-ad36-4416-904a-79cee392044c service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:08 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Took 1.03 seconds to deallocate network for instance.
Aug 15 02:19:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquired lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:19:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-29e6baf5-06bb-4226-8e48-7e52980615c2 req-f75a98c9-ad36-4416-904a-79cee392044c service nova] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Detach interface failed, port_id=297d9181-5888-4728-8b38-39fbe97d0992, reason: Instance 02572d81-b687-48ca-bb93-cedebe076fdf could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:19:08 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:08 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Took 0.62 seconds to deallocate network for instance.
Aug 15 02:19:09 user nova-compute[73121]: DEBUG nova.network.neutron [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating instance_info_cache with network_info: [{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Releasing lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-unplugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] Acquiring lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] No waiting events found dispatching network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:09 user nova-compute[73121]: WARNING nova.compute.manager [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received unexpected event network-vif-plugged-739b4e0a-f699-4550-8bf7-58935b4c9a18 for instance with vm_state active and task_state deleting.
Aug 15 02:19:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-78013e9a-96cb-4b1b-8e07-dfb87ead3e80 req-ccedc747-b642-49e2-b0c9-39f5e1333a1b service nova] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Received event network-vif-deleted-739b4e0a-f699-4550-8bf7-58935b4c9a18 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:09 user nova-compute[73121]: INFO nova.compute.manager [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Took 1.15 seconds to detach 1 volumes for instance.
Aug 15 02:19:09 user nova-compute[73121]: DEBUG os_brick.utils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b58bd7-c8a7-4125-9b80-f33cbe57cc3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c9553d-1699-48d7-b26e-cad31c78cf1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84d2014-d598-4aa6-9b70-9be340d3ab69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca64a52-e1e7-46f5-b4c7-435d9665cd95]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:19:09 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b04007-2421-4483-b126-30262e9da650]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG os_brick.utils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:19:09 user nova-compute[73121]: INFO nova.compute.manager [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Took 1.24 seconds to detach 1 volumes for instance.
Aug 15 02:19:09 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.066s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:09 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Deleted allocations for instance 02572d81-b687-48ca-bb93-cedebe076fdf
Aug 15 02:19:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-3d6509f6-9821-41f5-8d63-33c7dc5569aa tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "02572d81-b687-48ca-bb93-cedebe076fdf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.309s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:10 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:19:10 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:19:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:10 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Deleted allocations for instance f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845
Aug 15 02:19:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-252ddcbc-0b26-4b06-9f86-f62bead032f1 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.732s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Starting finish_migration {{(pid=73121) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Instance directory exists: not creating {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 02:19:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Creating image(s)
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Ensure instance console log exists: /opt/stack/data/nova/instances/454e5897-0179-41fb-a58d-c264831ee4a9/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Start _get_guest_xml network_info=[{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1247729830-network", "vif_mac": "fa:16:3e:b8:12:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'e479aa22-31c8-4539-bcf6-03d47be2dce5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdtmejLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '454e5897-0179-41fb-a58d-c264831ee4a9', 'attached_at': '2023-08-15T02:19:18.000000', 'detached_at': '', 'volume_id': 'a78d1dcd-f1cd-4805-bea8-79afa0919c27', 'serial': 'a78d1dcd-f1cd-4805-bea8-79afa0919c27'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:19:17 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:19:17 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.objects.instance [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'vcpu_model' on Instance uuid 454e5897-0179-41fb-a58d-c264831ee4a9 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdtmejLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:19:17 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:19:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:19:17 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:19:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:19:17 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d382db-d6ef-495c-9414-380ee0c94bc1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:19:17 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b319408b-c79d-4800-8a6f-a61e9c9e5316]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27] added
Aug 15 02:19:17 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.051s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3f7a01-fb80-4a80-9aef-605b77188086]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3df96b-1946-4df9-a39a-c475d06efdff]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdtmejLg {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdtmejLg" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adde3eb-60c6-4c25-9a43-653b45c0345e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UdtmejLg'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.046s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f179ba-76a1-4c1d-99ed-707563260e8c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[38015518-cb7d-4b48-99eb-d412be866119]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:19:18 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:19:18 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:19:18 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:19:18 user nova-compute[73121]: 
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7c4425-6e18-4183-9d85-03fd865435c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260]
Aug 15 02:19:18 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260] successful.
Aug 15 02:19:18 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[088e9a05-cb08-4515-95b9-f621ee9d54fb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fba1f3c-8409-4d94-82ea-13abd061a6e0]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:18 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:18 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6505a9-cc37-4098-a0fb-1fb9860e367e]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:19:18 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdtmejLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23732383033636238', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732383033636238', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2101332850',display_name='tempest-ServerActionsTestOtherA-server-2101332850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2101332850',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdD9feBUtKJxWabCOxeEfVUYblkUx99maantL29ickzkNiSka7JcOd7LAkLzENREY7q67OdhUq5n4xklCuCa82bJF6NH8tngV7k73jmjSgmnNbURsM8zWbxOgcKQEI/Q==',key_name='tempest-keypair-556442797',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-1c2cui6c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=454e5897-0179-41fb-a58d-c264831ee4a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1247729830-network", "vif_mac": "fa:16:3e:b8:12:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1247729830-network", "vif_mac": "fa:16:3e:b8:12:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:19:19 user nova-compute[73121]:   <uuid>454e5897-0179-41fb-a58d-c264831ee4a9</uuid>
Aug 15 02:19:19 user nova-compute[73121]:   <name>instance-00000025</name>
Aug 15 02:19:19 user nova-compute[73121]:   <memory>2097152</memory>
Aug 15 02:19:19 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:19:19 user nova-compute[73121]:   <metadata>
Aug 15 02:19:19 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:19:19 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:19:19 user nova-compute[73121]:       <nova:name>tempest-ServerActionsTestOtherA-server-2101332850</nova:name>
Aug 15 02:19:19 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:19:17</nova:creationTime>
Aug 15 02:19:19 user nova-compute[73121]:       <nova:flavor name="m1.small">
Aug 15 02:19:19 user nova-compute[73121]:         <nova:memory>2048</nova:memory>
Aug 15 02:19:19 user nova-compute[73121]:         <nova:disk>20</nova:disk>
Aug 15 02:19:19 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:19:19 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:19:19 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:19:19 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:19:19 user nova-compute[73121]:       <nova:owner>
Aug 15 02:19:19 user nova-compute[73121]:         <nova:user uuid="f22753e4f3934dddab87961c43c68fb2">tempest-ServerActionsTestOtherA-148244694-project-member</nova:user>
Aug 15 02:19:19 user nova-compute[73121]:         <nova:project uuid="fb0739b6fd0a4c3097a1e0d329176a78">tempest-ServerActionsTestOtherA-148244694</nova:project>
Aug 15 02:19:19 user nova-compute[73121]:       </nova:owner>
Aug 15 02:19:19 user nova-compute[73121]:       <nova:ports>
Aug 15 02:19:19 user nova-compute[73121]:         <nova:port uuid="7c725b88-d99b-4290-b3e7-6152fb3432ee">
Aug 15 02:19:19 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 02:19:19 user nova-compute[73121]:         </nova:port>
Aug 15 02:19:19 user nova-compute[73121]:       </nova:ports>
Aug 15 02:19:19 user nova-compute[73121]:     </nova:instance>
Aug 15 02:19:19 user nova-compute[73121]:   </metadata>
Aug 15 02:19:19 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:19:19 user nova-compute[73121]:     <system>
Aug 15 02:19:19 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:19:19 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:19:19 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:19:19 user nova-compute[73121]:       <entry name="serial">454e5897-0179-41fb-a58d-c264831ee4a9</entry>
Aug 15 02:19:19 user nova-compute[73121]:       <entry name="uuid">454e5897-0179-41fb-a58d-c264831ee4a9</entry>
Aug 15 02:19:19 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:19:19 user nova-compute[73121]:     </system>
Aug 15 02:19:19 user nova-compute[73121]:   </sysinfo>
Aug 15 02:19:19 user nova-compute[73121]:   <os>
Aug 15 02:19:19 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:19:19 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:19:19 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:19:19 user nova-compute[73121]:   </os>
Aug 15 02:19:19 user nova-compute[73121]:   <features>
Aug 15 02:19:19 user nova-compute[73121]:     <acpi/>
Aug 15 02:19:19 user nova-compute[73121]:     <apic/>
Aug 15 02:19:19 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:19:19 user nova-compute[73121]:   </features>
Aug 15 02:19:19 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:19:19 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:19:19 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:19:19 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:19:19 user nova-compute[73121]:   </clock>
Aug 15 02:19:19 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:19:19 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:19:19 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:19:19 user nova-compute[73121]:   </cpu>
Aug 15 02:19:19 user nova-compute[73121]:   <devices>
Aug 15 02:19:19 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:19:19 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:19:19 user nova-compute[73121]:       <source dev="/dev/sdb"/>
Aug 15 02:19:19 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:19:19 user nova-compute[73121]:       <serial>a78d1dcd-f1cd-4805-bea8-79afa0919c27</serial>
Aug 15 02:19:19 user nova-compute[73121]:     </disk>
Aug 15 02:19:19 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:19:19 user nova-compute[73121]:       <mac address="fa:16:3e:b8:12:7a"/>
Aug 15 02:19:19 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:19:19 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:19:19 user nova-compute[73121]:       <target dev="tap7c725b88-d9"/>
Aug 15 02:19:19 user nova-compute[73121]:     </interface>
Aug 15 02:19:19 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:19:19 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/454e5897-0179-41fb-a58d-c264831ee4a9/console.log" append="off"/>
Aug 15 02:19:19 user nova-compute[73121]:     </serial>
Aug 15 02:19:19 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:19:19 user nova-compute[73121]:     <video>
Aug 15 02:19:19 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:19:19 user nova-compute[73121]:     </video>
Aug 15 02:19:19 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:19:19 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:19:19 user nova-compute[73121]:     </rng>
Aug 15 02:19:19 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:19:19 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:19:19 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:19:19 user nova-compute[73121]:     </memballoon>
Aug 15 02:19:19 user nova-compute[73121]:   </devices>
Aug 15 02:19:19 user nova-compute[73121]: </domain>
Aug 15 02:19:19 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2101332850',display_name='tempest-ServerActionsTestOtherA-server-2101332850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2101332850',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdD9feBUtKJxWabCOxeEfVUYblkUx99maantL29ickzkNiSka7JcOd7LAkLzENREY7q67OdhUq5n4xklCuCa82bJF6NH8tngV7k73jmjSgmnNbURsM8zWbxOgcKQEI/Q==',key_name='tempest-keypair-556442797',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:17:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-1c2cui6c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:19:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=454e5897-0179-41fb-a58d-c264831ee4a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1247729830-network", "vif_mac": "fa:16:3e:b8:12:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1247729830-network", "vif_mac": "fa:16:3e:b8:12:7a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG os_vif [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c725b88-d9, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c725b88-d9, col_values=(('external_ids', {'iface-id': '7c725b88-d99b-4290-b3e7-6152fb3432ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:12:7a', 'vm-uuid': '454e5897-0179-41fb-a58d-c264831ee4a9'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:19 user nova-compute[73121]: INFO os_vif [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9')
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] No VIF found with MAC fa:16:3e:b8:12:7a, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065944.7530394, 9bfaa36f-2822-47de-8d12-823e38b4aae4 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:19 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] VM Stopped (Lifecycle Event)
Aug 15 02:19:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c28f4a7-32a3-41e2-b961-5cfe46a57a9b None None] [instance: 9bfaa36f-2822-47de-8d12-823e38b4aae4] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:20 user nova-compute[73121]: DEBUG nova.compute.manager [req-005b9e46-538d-43f9-9272-278b9fc8db27 req-13ee22d7-e5c7-4c15-8ff1-f01edd8e56a5 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-005b9e46-538d-43f9-9272-278b9fc8db27 req-13ee22d7-e5c7-4c15-8ff1-f01edd8e56a5 service nova] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-005b9e46-538d-43f9-9272-278b9fc8db27 req-13ee22d7-e5c7-4c15-8ff1-f01edd8e56a5 service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-005b9e46-538d-43f9-9272-278b9fc8db27 req-13ee22d7-e5c7-4c15-8ff1-f01edd8e56a5 service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:20 user nova-compute[73121]: DEBUG nova.compute.manager [req-005b9e46-538d-43f9-9272-278b9fc8db27 req-13ee22d7-e5c7-4c15-8ff1-f01edd8e56a5 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] No waiting events found dispatching network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:20 user nova-compute[73121]: WARNING nova.compute.manager [req-005b9e46-538d-43f9-9272-278b9fc8db27 req-13ee22d7-e5c7-4c15-8ff1-f01edd8e56a5 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received unexpected event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee for instance with vm_state active and task_state resize_finish.
Aug 15 02:19:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:21 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065945.9994354, 454e5897-0179-41fb-a58d-c264831ee4a9 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:21 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] VM Stopped (Lifecycle Event)
Aug 15 02:19:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a397382a-3e4c-4bac-831b-e5fc078f5a1e None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:21 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065946.534623, 02572d81-b687-48ca-bb93-cedebe076fdf => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:21 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] VM Stopped (Lifecycle Event)
Aug 15 02:19:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5e5ec325-32f6-4167-bd27-08f42bf88d77 None None] [instance: 02572d81-b687-48ca-bb93-cedebe076fdf] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065947.3335993, f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:22 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] VM Stopped (Lifecycle Event)
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-11385eea-fc16-4736-b3b1-e6ee79fc6a2f None None] [instance: f1b9d3fb-477d-4ee1-8bbb-3aeccd2ee845] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065962.7034419, 454e5897-0179-41fb-a58d-c264831ee4a9 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:22 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] VM Resumed (Lifecycle Event)
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:19:22 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Instance running successfully.
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Failed to set time: agent not configured {{(pid=73121) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-a377aab2-558a-458f-a4c3-2b0c7177057a tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] finish_migration finished successfully. {{(pid=73121) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:19:22 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065962.7049394, 454e5897-0179-41fb-a58d-c264831ee4a9 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:22 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] VM Started (Lifecycle Event)
Aug 15 02:19:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:19:22 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-01deff1d-3f26-4b56-9a92-6e7dca146eae req-7c30151e-ee15-4545-9673-af848addd72f service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-01deff1d-3f26-4b56-9a92-6e7dca146eae req-7c30151e-ee15-4545-9673-af848addd72f service nova] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-01deff1d-3f26-4b56-9a92-6e7dca146eae req-7c30151e-ee15-4545-9673-af848addd72f service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-01deff1d-3f26-4b56-9a92-6e7dca146eae req-7c30151e-ee15-4545-9673-af848addd72f service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-01deff1d-3f26-4b56-9a92-6e7dca146eae req-7c30151e-ee15-4545-9673-af848addd72f service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] No waiting events found dispatching network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:22 user nova-compute[73121]: WARNING nova.compute.manager [req-01deff1d-3f26-4b56-9a92-6e7dca146eae req-7c30151e-ee15-4545-9673-af848addd72f service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received unexpected event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee for instance with vm_state resized and task_state None.
Aug 15 02:19:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:19:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:19:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:19:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:19:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:19:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:19:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:19:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:19:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:19:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid ad8b33e3-c58c-4182-a43a-248f5f1face1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updating instance_info_cache with network_info: [{"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-ad8b33e3-c58c-4182-a43a-248f5f1face1" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:33 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:19:33 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7949MB free_disk=25.224685668945312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Applying migration context for instance 454e5897-0179-41fb-a58d-c264831ee4a9 as it has an incoming, in-progress migration 99d635e8-969e-4c08-b8c7-eba1f02508c6. Migration status is finished {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 02:19:33 user nova-compute[73121]: INFO nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating resource usage from migration 99d635e8-969e-4c08-b8c7-eba1f02508c6
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1145ac04-f2f8-49d3-a54e-365f7269d8be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Migration 99d635e8-969e-4c08-b8c7-eba1f02508c6 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 454e5897-0179-41fb-a58d-c264831ee4a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:19:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'flavor' on Instance uuid 6fb561dc-705f-4bde-98a5-2076a9e1f8fe {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:34 user nova-compute[73121]: INFO nova.compute.manager [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Attaching volume e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 to /dev/vdb
Aug 15 02:19:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5591e1e-bde0-44f1-a4b6-ccf10f0aedd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8287a172-bfa1-40bf-8f38-fc3c02fa75e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eb675f-55c7-47b3-aa5c-63a0e580da17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82b4c0e-478f-4458-9ab1-0ce280ea3e00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:19:34 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:19:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfc4568-88b1-4d88-87e3-bf6c0440ccf1]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:19:34 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating existing volume attachment record: 8cea8197-6a17-43a3-8b65-30b4395ec827 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:19:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:19:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkDoqCgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:19:43 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:19:43 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:19:43 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[14398337-d999-4999-8c5b-bfe146cec6ba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:19:43 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2110cd1-abb5-4e39-8ed2-f5e56cdc22fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7] added
Aug 15 02:19:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5f33b9-9338-4644-aed6-787dcaaf16bc]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca9f066-91dd-47cb-87b6-e99b82cbf90e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkDoqCgb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkDoqCgb" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4eb9123-6565-42d7-a75c-1a69f6bbf9f1]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vkDoqCgb'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.099s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34869a7-1982-41e2-acf0-916bbe24f8ca]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.115s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4abff5b-ff98-489d-95bb-10ccddafae1a]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77028f5-f3e4-4fc3-9e06-873ba04bff74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7, portal: 172.16.0.220,3260]
Aug 15 02:19:43 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7, portal: 172.16.0.220,3260] successful.
Aug 15 02:19:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1626a-4b59-4f11-abe5-a6515a9e8a4f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49604f1-0aec-4fc5-8226-475d56dc32e9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:43 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:19:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:19:43 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:19:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.609s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7758839-4c7b-44a5-bc38-d3b2b76bc8e6]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:19:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkDoqCgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:19:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.648s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:19:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] <== connect_volume: return (1650ms) {'type': 'block', 'scsi_wwn': '23561633966393733', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:19:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561633966393733', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:19:44 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'flavor' on Instance uuid 6fb561dc-705f-4bde-98a5-2076a9e1f8fe {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:19:44 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:19:44 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:19:44 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:19:44 user nova-compute[73121]:   <serial>e68500c2-5ad3-4b14-b2cb-39c6cf8778a7</serial>
Aug 15 02:19:44 user nova-compute[73121]: </disk>
Aug 15 02:19:44 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:19:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:19:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:19:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] No VIF found with MAC fa:16:3e:9f:fa:55, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:19:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6a68d791-762e-43b9-a3b7-92e5dbac4c85 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.121s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:19:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:46 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:19:46 user nova-compute[73121]: INFO nova.compute.claims [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Claim successful on node user
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.network.neutron [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:19:47 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.policy [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f199d32620e4c0d9d48b9737d2f8f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7093d5ade03430488a4713acba49588', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:19:47 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Creating image(s)
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "/opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "/opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "/opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk 1073741824" returned: 0 in 0.052s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:19:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.network.neutron [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Successfully created port: 3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Cannot resize image /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.objects.instance [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'migration_context' on Instance uuid 62fc764f-1ca0-4916-ab0f-b822c9070c8c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Ensure instance console log exists: /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-ea01bf94-bd2c-48b2-adae-eea2b6e2d88d req-6d23b687-16a8-4145-9aad-3111505368db service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-ea01bf94-bd2c-48b2-adae-eea2b6e2d88d req-6d23b687-16a8-4145-9aad-3111505368db service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing instance network info cache due to event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ea01bf94-bd2c-48b2-adae-eea2b6e2d88d req-6d23b687-16a8-4145-9aad-3111505368db service nova] Acquiring lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ea01bf94-bd2c-48b2-adae-eea2b6e2d88d req-6d23b687-16a8-4145-9aad-3111505368db service nova] Acquired lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-ea01bf94-bd2c-48b2-adae-eea2b6e2d88d req-6d23b687-16a8-4145-9aad-3111505368db service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.network.neutron [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Successfully updated port: 3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-ea01bf94-bd2c-48b2-adae-eea2b6e2d88d req-6d23b687-16a8-4145-9aad-3111505368db service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updated VIF entry in instance network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-ea01bf94-bd2c-48b2-adae-eea2b6e2d88d req-6d23b687-16a8-4145-9aad-3111505368db service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating instance_info_cache with network_info: [{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "refresh_cache-62fc764f-1ca0-4916-ab0f-b822c9070c8c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquired lock "refresh_cache-62fc764f-1ca0-4916-ab0f-b822c9070c8c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.network.neutron [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ea01bf94-bd2c-48b2-adae-eea2b6e2d88d req-6d23b687-16a8-4145-9aad-3111505368db service nova] Releasing lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-6ef51515-6af0-4c68-b588-f3f2485076eb req-4a783351-c385-43e4-a216-bf2fdfc50f74 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received event network-changed-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-6ef51515-6af0-4c68-b588-f3f2485076eb req-4a783351-c385-43e4-a216-bf2fdfc50f74 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Refreshing instance network info cache due to event network-changed-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:19:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ef51515-6af0-4c68-b588-f3f2485076eb req-4a783351-c385-43e4-a216-bf2fdfc50f74 service nova] Acquiring lock "refresh_cache-62fc764f-1ca0-4916-ab0f-b822c9070c8c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Updating instance_info_cache with network_info: [{"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Releasing lock "refresh_cache-62fc764f-1ca0-4916-ab0f-b822c9070c8c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Instance network_info: |[{"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ef51515-6af0-4c68-b588-f3f2485076eb req-4a783351-c385-43e4-a216-bf2fdfc50f74 service nova] Acquired lock "refresh_cache-62fc764f-1ca0-4916-ab0f-b822c9070c8c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-6ef51515-6af0-4c68-b588-f3f2485076eb req-4a783351-c385-43e4-a216-bf2fdfc50f74 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Refreshing network info cache for port 3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Start _get_guest_xml network_info=[{"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:19:49 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:19:49 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1263102305',display_name='tempest-VolumesSnapshotTestJSON-instance-1263102305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1263102305',id=40,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbJhzu5lwB3NYHKk6+oLOW4ftT6XcQ7F2hVPeU3KpP6Efnr9jqAM1nSeDijWSYn7FDu9WlySZv30FotIRHoz8aFMD0dIJIsNbHe71CRK61gAJZSQpK3Tytxwmrzp7SM+A==',key_name='tempest-keypair-1795842592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7093d5ade03430488a4713acba49588',ramdisk_id='',reservation_id='r-uhgyh6sv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1030319394',owner_user_name='tempest-VolumesSnapshotTestJSON-1030319394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f199d32620e4c0d9d48b9737d2f8f23',uuid=62fc764f-1ca0-4916-ab0f-b822c9070c8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converting VIF {"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:1a:00,bridge_name='br-int',has_traffic_filtering=True,id=3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9d2dc5-74') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'pci_devices' on Instance uuid 62fc764f-1ca0-4916-ab0f-b822c9070c8c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:19:49 user nova-compute[73121]:   <uuid>62fc764f-1ca0-4916-ab0f-b822c9070c8c</uuid>
Aug 15 02:19:49 user nova-compute[73121]:   <name>instance-00000028</name>
Aug 15 02:19:49 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:19:49 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:19:49 user nova-compute[73121]:   <metadata>
Aug 15 02:19:49 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:19:49 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:19:49 user nova-compute[73121]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1263102305</nova:name>
Aug 15 02:19:49 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:19:49</nova:creationTime>
Aug 15 02:19:49 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:19:49 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:19:49 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:19:49 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:19:49 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:19:49 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:19:49 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:19:49 user nova-compute[73121]:       <nova:owner>
Aug 15 02:19:49 user nova-compute[73121]:         <nova:user uuid="7f199d32620e4c0d9d48b9737d2f8f23">tempest-VolumesSnapshotTestJSON-1030319394-project-member</nova:user>
Aug 15 02:19:49 user nova-compute[73121]:         <nova:project uuid="b7093d5ade03430488a4713acba49588">tempest-VolumesSnapshotTestJSON-1030319394</nova:project>
Aug 15 02:19:49 user nova-compute[73121]:       </nova:owner>
Aug 15 02:19:49 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:19:49 user nova-compute[73121]:       <nova:ports>
Aug 15 02:19:49 user nova-compute[73121]:         <nova:port uuid="3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a">
Aug 15 02:19:49 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:19:49 user nova-compute[73121]:         </nova:port>
Aug 15 02:19:49 user nova-compute[73121]:       </nova:ports>
Aug 15 02:19:49 user nova-compute[73121]:     </nova:instance>
Aug 15 02:19:49 user nova-compute[73121]:   </metadata>
Aug 15 02:19:49 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:19:49 user nova-compute[73121]:     <system>
Aug 15 02:19:49 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:19:49 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:19:49 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:19:49 user nova-compute[73121]:       <entry name="serial">62fc764f-1ca0-4916-ab0f-b822c9070c8c</entry>
Aug 15 02:19:49 user nova-compute[73121]:       <entry name="uuid">62fc764f-1ca0-4916-ab0f-b822c9070c8c</entry>
Aug 15 02:19:49 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:19:49 user nova-compute[73121]:     </system>
Aug 15 02:19:49 user nova-compute[73121]:   </sysinfo>
Aug 15 02:19:49 user nova-compute[73121]:   <os>
Aug 15 02:19:49 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:19:49 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:19:49 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:19:49 user nova-compute[73121]:   </os>
Aug 15 02:19:49 user nova-compute[73121]:   <features>
Aug 15 02:19:49 user nova-compute[73121]:     <acpi/>
Aug 15 02:19:49 user nova-compute[73121]:     <apic/>
Aug 15 02:19:49 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:19:49 user nova-compute[73121]:   </features>
Aug 15 02:19:49 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:19:49 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:19:49 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:19:49 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:19:49 user nova-compute[73121]:   </clock>
Aug 15 02:19:49 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:19:49 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:19:49 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:19:49 user nova-compute[73121]:   </cpu>
Aug 15 02:19:49 user nova-compute[73121]:   <devices>
Aug 15 02:19:49 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:19:49 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:19:49 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk"/>
Aug 15 02:19:49 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:19:49 user nova-compute[73121]:     </disk>
Aug 15 02:19:49 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:19:49 user nova-compute[73121]:       <mac address="fa:16:3e:74:1a:00"/>
Aug 15 02:19:49 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:19:49 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:19:49 user nova-compute[73121]:       <target dev="tap3b9d2dc5-74"/>
Aug 15 02:19:49 user nova-compute[73121]:     </interface>
Aug 15 02:19:49 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:19:49 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/console.log" append="off"/>
Aug 15 02:19:49 user nova-compute[73121]:     </serial>
Aug 15 02:19:49 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:19:49 user nova-compute[73121]:     <video>
Aug 15 02:19:49 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:19:49 user nova-compute[73121]:     </video>
Aug 15 02:19:49 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:19:49 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:19:49 user nova-compute[73121]:     </rng>
Aug 15 02:19:49 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:19:49 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:19:49 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:19:49 user nova-compute[73121]:     </memballoon>
Aug 15 02:19:49 user nova-compute[73121]:   </devices>
Aug 15 02:19:49 user nova-compute[73121]: </domain>
Aug 15 02:19:49 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1263102305',display_name='tempest-VolumesSnapshotTestJSON-instance-1263102305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1263102305',id=40,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbJhzu5lwB3NYHKk6+oLOW4ftT6XcQ7F2hVPeU3KpP6Efnr9jqAM1nSeDijWSYn7FDu9WlySZv30FotIRHoz8aFMD0dIJIsNbHe71CRK61gAJZSQpK3Tytxwmrzp7SM+A==',key_name='tempest-keypair-1795842592',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7093d5ade03430488a4713acba49588',ramdisk_id='',reservation_id='r-uhgyh6sv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1030319394',owner_user_name='tempest-VolumesSnapshotTestJSON-1030319394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:19:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f199d32620e4c0d9d48b9737d2f8f23',uuid=62fc764f-1ca0-4916-ab0f-b822c9070c8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converting VIF {"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:1a:00,bridge_name='br-int',has_traffic_filtering=True,id=3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9d2dc5-74') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG os_vif [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:1a:00,bridge_name='br-int',has_traffic_filtering=True,id=3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9d2dc5-74') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b9d2dc5-74, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b9d2dc5-74, col_values=(('external_ids', {'iface-id': '3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:1a:00', 'vm-uuid': '62fc764f-1ca0-4916-ab0f-b822c9070c8c'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:49 user nova-compute[73121]: INFO os_vif [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:1a:00,bridge_name='br-int',has_traffic_filtering=True,id=3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9d2dc5-74')
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No VIF found with MAC fa:16:3e:74:1a:00, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-6ef51515-6af0-4c68-b588-f3f2485076eb req-4a783351-c385-43e4-a216-bf2fdfc50f74 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Updated VIF entry in instance network info cache for port 3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG nova.network.neutron [req-6ef51515-6af0-4c68-b588-f3f2485076eb req-4a783351-c385-43e4-a216-bf2fdfc50f74 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Updating instance_info_cache with network_info: [{"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6ef51515-6af0-4c68-b588-f3f2485076eb req-4a783351-c385-43e4-a216-bf2fdfc50f74 service nova] Releasing lock "refresh_cache-62fc764f-1ca0-4916-ab0f-b822c9070c8c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-389112d1-2ed3-4115-9858-2b4f43b2d855 req-d3470574-18fd-46cd-8577-ae3e4f56d152 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-389112d1-2ed3-4115-9858-2b4f43b2d855 req-d3470574-18fd-46cd-8577-ae3e4f56d152 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing instance network info cache due to event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:19:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-389112d1-2ed3-4115-9858-2b4f43b2d855 req-d3470574-18fd-46cd-8577-ae3e4f56d152 service nova] Acquiring lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-389112d1-2ed3-4115-9858-2b4f43b2d855 req-d3470574-18fd-46cd-8577-ae3e4f56d152 service nova] Acquired lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-389112d1-2ed3-4115-9858-2b4f43b2d855 req-d3470574-18fd-46cd-8577-ae3e4f56d152 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:19:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:51 user nova-compute[73121]: INFO nova.compute.manager [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Rebooting instance
Aug 15 02:19:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-389112d1-2ed3-4115-9858-2b4f43b2d855 req-d3470574-18fd-46cd-8577-ae3e4f56d152 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updated VIF entry in instance network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-389112d1-2ed3-4115-9858-2b4f43b2d855 req-d3470574-18fd-46cd-8577-ae3e4f56d152 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating instance_info_cache with network_info: [{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-389112d1-2ed3-4115-9858-2b4f43b2d855 req-d3470574-18fd-46cd-8577-ae3e4f56d152 service nova] Releasing lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquired lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:19:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.network.neutron [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating instance_info_cache with network_info: [{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Releasing lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received event network-vif-plugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] No waiting events found dispatching network-vif-plugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:52 user nova-compute[73121]: WARNING nova.compute.manager [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received unexpected event network-vif-plugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a for instance with vm_state building and task_state spawning.
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received event network-vif-plugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] No waiting events found dispatching network-vif-plugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:52 user nova-compute[73121]: WARNING nova.compute.manager [req-093eccc7-9202-43aa-8edf-b6c5095c30a7 req-a6038b68-e556-4334-a17c-e0bed75f66b6 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received unexpected event network-vif-plugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a for instance with vm_state building and task_state spawning.
Aug 15 02:19:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:52 user nova-compute[73121]: INFO nova.compute.manager [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Terminating instance
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065992.9887626, 62fc764f-1ca0-4916-ab0f-b822c9070c8c => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:52 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] VM Resumed (Lifecycle Event)
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:19:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Instance spawned successfully.
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065992.9900532, 62fc764f-1ca0-4916-ab0f-b822c9070c8c => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] VM Started (Lifecycle Event)
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Took 5.83 seconds to spawn the instance on the hypervisor.
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.compute.manager [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Took 6.47 seconds to build instance.
Aug 15 02:19:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-efb8c3a5-d660-48f7-a29f-a45fcc1ca1e9 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.600s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Instance destroyed successfully.
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lazy-loading 'resources' on Instance uuid 1145ac04-f2f8-49d3-a54e-365f7269d8be {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:15:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-918626307',display_name='tempest-TestServerVolumeAttachmentScenario-server-918626307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-918626307',id=34,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvAxvKWo4lmNaemXtxJ+WeoYTeTQHUwrbgik4L76i7oTL26+E5lAuRVYy9PbCtZhPfkgIXXUvTcxuFLec98hpHY6OoSr1gXdYsIVX6zwzHXk00X2iirNBYIT6gP290Vjw==',key_name='tempest-keypair-435126425',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b8d2c7595ca84d28af1b3ed80af23083',ramdisk_id='',reservation_id='r-6w4k026t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2144598730',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2144598730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:15:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='960751aa323442baa938225afc04d825',uuid=1145ac04-f2f8-49d3-a54e-365f7269d8be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Converting VIF {"id": "32084794-2862-47ab-b42f-d7d464ced12c", "address": "fa:16:3e:78:dc:e8", "network": {"id": "c2a0f6dc-7e55-4e7b-be97-e42be7495860", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-405114467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b8d2c7595ca84d28af1b3ed80af23083", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32084794-28", "ovs_interfaceid": "32084794-2862-47ab-b42f-d7d464ced12c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:dc:e8,bridge_name='br-int',has_traffic_filtering=True,id=32084794-2862-47ab-b42f-d7d464ced12c,network=Network(c2a0f6dc-7e55-4e7b-be97-e42be7495860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32084794-28') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG os_vif [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:dc:e8,bridge_name='br-int',has_traffic_filtering=True,id=32084794-2862-47ab-b42f-d7d464ced12c,network=Network(c2a0f6dc-7e55-4e7b-be97-e42be7495860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32084794-28') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32084794-28, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:53 user nova-compute[73121]: INFO os_vif [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:dc:e8,bridge_name='br-int',has_traffic_filtering=True,id=32084794-2862-47ab-b42f-d7d464ced12c,network=Network(c2a0f6dc-7e55-4e7b-be97-e42be7495860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32084794-28')
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Deleting instance files /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be_del
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Deletion of /opt/stack/data/nova/instances/1145ac04-f2f8-49d3-a54e-365f7269d8be_del complete
Aug 15 02:19:53 user nova-compute[73121]: INFO nova.compute.manager [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 02:19:53 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:19:53 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:54 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Took 0.72 seconds to deallocate network for instance.
Aug 15 02:19:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received event network-vif-unplugged-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] No waiting events found dispatching network-vif-unplugged-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:54 user nova-compute[73121]: WARNING nova.compute.manager [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received unexpected event network-vif-unplugged-32084794-2862-47ab-b42f-d7d464ced12c for instance with vm_state deleted and task_state None.
Aug 15 02:19:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received event network-vif-plugged-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] Acquiring lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] No waiting events found dispatching network-vif-plugged-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:54 user nova-compute[73121]: WARNING nova.compute.manager [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received unexpected event network-vif-plugged-32084794-2862-47ab-b42f-d7d464ced12c for instance with vm_state deleted and task_state None.
Aug 15 02:19:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-69bac5ab-4201-411c-bacf-9d6d5ab7f81b req-01cf7282-d879-4a5a-9c51-22989f297225 service nova] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Received event network-vif-deleted-32084794-2862-47ab-b42f-d7d464ced12c {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:19:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:54 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Deleted allocations for instance 1145ac04-f2f8-49d3-a54e-365f7269d8be
Aug 15 02:19:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2650e1fc-f01a-427f-bae2-3fdf8473e719 tempest-TestServerVolumeAttachmentScenario-2144598730 tempest-TestServerVolumeAttachmentScenario-2144598730-project-member] Lock "1145ac04-f2f8-49d3-a54e-365f7269d8be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.222s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:55 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Instance shutdown successfully.
Aug 15 02:19:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-unplugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] No waiting events found dispatching network-vif-unplugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:56 user nova-compute[73121]: WARNING nova.compute.manager [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received unexpected event network-vif-unplugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 for instance with vm_state active and task_state reboot_started.
Aug 15 02:19:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] No waiting events found dispatching network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:56 user nova-compute[73121]: WARNING nova.compute.manager [req-2f95e647-2b04-47f0-82da-c41fa2b41c09 req-d367310f-8029-4ef1-bf1c-820a5489a8b8 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received unexpected event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 for instance with vm_state active and task_state reboot_started.
Aug 15 02:19:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:19:57 user nova-compute[73121]: INFO nova.compute.claims [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Claim successful on node user
Aug 15 02:19:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:19:57 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:58 user nova-compute[73121]: INFO nova.compute.manager [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Terminating instance
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:19:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:58 user nova-compute[73121]: INFO nova.virt.block_device [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Booting with volume 8227d1ba-6670-4189-85dd-7d91a9409e5d at /dev/vda
Aug 15 02:19:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.policy [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f9c4f2ffebb440cb88132a502d51811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3397dd14ca44c19dc4386aec30a9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG os_brick.utils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a43b10-5cef-491e-8241-a9b831ba5454]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e0725d-90e5-4826-b2e9-a033cf4b785b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9721a843-6d6a-40de-8de8-1c7a2236382a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[57800b11-3845-4e85-b6c6-fab4f7f5e36b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:19:58 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[665d6227-ec33-4582-97dc-fbe614973f63]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG os_brick.utils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updating existing volume attachment record: 47c66987-af59-4215-b4c2-63f11da6093e {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] No waiting events found dispatching network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:58 user nova-compute[73121]: WARNING nova.compute.manager [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received unexpected event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 for instance with vm_state active and task_state reboot_started.
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] No waiting events found dispatching network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:58 user nova-compute[73121]: WARNING nova.compute.manager [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received unexpected event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 for instance with vm_state active and task_state reboot_started.
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received event network-vif-unplugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] Acquiring lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] No waiting events found dispatching network-vif-unplugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b3e9eb4-72db-4d0d-b961-bd97509fe978 req-11070d6c-e5a3-4719-925b-4bcfea4a88c0 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received event network-vif-unplugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:19:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Instance destroyed successfully.
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lazy-loading 'resources' on Instance uuid ad8b33e3-c58c-4182-a43a-248f5f1face1 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-227119013',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-227119013',id=1,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:00:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea879c6a9d1f4d58998e077524a07225',ramdisk_id='',reservation_id='r-03v2ficv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893410799',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:02:16Z,user_data=None,user_id='4d8ef0b0581e4a10b066c15119bafde1',uuid=ad8b33e3-c58c-4182-a43a-248f5f1face1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converting VIF {"id": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "address": "fa:16:3e:1b:ef:02", "network": {"id": "44055eaf-1c82-478a-bfc8-2eb37000b268", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1552009974-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea879c6a9d1f4d58998e077524a07225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3309b3f-6c", "ovs_interfaceid": "d3309b3f-6cf7-4ab3-92df-54f35121ff91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ef:02,bridge_name='br-int',has_traffic_filtering=True,id=d3309b3f-6cf7-4ab3-92df-54f35121ff91,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3309b3f-6c') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG os_vif [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ef:02,bridge_name='br-int',has_traffic_filtering=True,id=d3309b3f-6cf7-4ab3-92df-54f35121ff91,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3309b3f-6c') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3309b3f-6c, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:19:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:19:59 user nova-compute[73121]: INFO os_vif [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:ef:02,bridge_name='br-int',has_traffic_filtering=True,id=d3309b3f-6cf7-4ab3-92df-54f35121ff91,network=Network(44055eaf-1c82-478a-bfc8-2eb37000b268),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3309b3f-6c')
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Deleting instance files /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1_del
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Deletion of /opt/stack/data/nova/instances/ad8b33e3-c58c-4182-a43a-248f5f1face1_del complete
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.compute.manager [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 15 02:19:59 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for 6fb561dc-705f-4bde-98a5-2076a9e1f8fe due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065999.4474251, 6fb561dc-705f-4bde-98a5-2076a9e1f8fe => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] VM Resumed (Lifecycle Event)
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Instance running successfully.
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Instance soft rebooted successfully.
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692065999.4475863, 6fb561dc-705f-4bde-98a5-2076a9e1f8fe => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] VM Started (Lifecycle Event)
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Successfully created port: d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-39e88eac-5b62-4255-a246-916cbb3927ee tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.277s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Took 0.68 seconds to deallocate network for instance.
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-4992f656-0fff-4f06-9468-ac88abd7b095 req-c5ea0bae-c0bc-4096-8937-23cdeb894f79 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received event network-vif-deleted-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:19:59 user nova-compute[73121]: INFO nova.compute.manager [req-4992f656-0fff-4f06-9468-ac88abd7b095 req-c5ea0bae-c0bc-4096-8937-23cdeb894f79 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Neutron deleted interface d3309b3f-6cf7-4ab3-92df-54f35121ff91; detaching it from the instance and deleting it from the info cache
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-4992f656-0fff-4f06-9468-ac88abd7b095 req-c5ea0bae-c0bc-4096-8937-23cdeb894f79 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-4992f656-0fff-4f06-9468-ac88abd7b095 req-c5ea0bae-c0bc-4096-8937-23cdeb894f79 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Detach interface failed, port_id=d3309b3f-6cf7-4ab3-92df-54f35121ff91, reason: Instance ad8b33e3-c58c-4182-a43a-248f5f1face1 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:19:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:00 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:20:00 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:20:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:00 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Deleted allocations for instance ad8b33e3-c58c-4182-a43a-248f5f1face1
Aug 15 02:20:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0f94829a-9de5-4982-a5c9-967a3f3f4c16 tempest-ServerBootFromVolumeStableRescueTest-893410799 tempest-ServerBootFromVolumeStableRescueTest-893410799-project-member] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:00 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Successfully updated port: d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:20:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:20:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquired lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:20:00 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:20:00 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updating instance_info_cache with network_info: [{"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received event network-vif-plugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] Acquiring lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] Lock "ad8b33e3-c58c-4182-a43a-248f5f1face1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] No waiting events found dispatching network-vif-plugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:20:01 user nova-compute[73121]: WARNING nova.compute.manager [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Received unexpected event network-vif-plugged-d3309b3f-6cf7-4ab3-92df-54f35121ff91 for instance with vm_state deleted and task_state None.
Aug 15 02:20:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received event network-changed-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Refreshing instance network info cache due to event network-changed-d971bce8-66de-4835-b772-b89e99985897. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] Acquiring lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Releasing lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Instance network_info: |[{"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] Acquired lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG nova.network.neutron [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Refreshing network info cache for port d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG nova.network.neutron [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updated VIF entry in instance network info cache for port d971bce8-66de-4835-b772-b89e99985897. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG nova.network.neutron [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updating instance_info_cache with network_info: [{"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:20:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-45a1085f-a354-4cd5-9be5-89ce88244460 req-104779f2-df05-4222-a8ae-9c062997c3b4 service nova] Releasing lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:20:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065993.6636782, 1145ac04-f2f8-49d3-a54e-365f7269d8be => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:20:08 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] VM Stopped (Lifecycle Event)
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6847b621-6216-48fc-81e3-686e271884b1 None None] [instance: 1145ac04-f2f8-49d3-a54e-365f7269d8be] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:20:08 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Creating image(s)
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Ensure instance console log exists: /opt/stack/data/nova/instances/1cdacf7e-1d4d-4e58-857a-f70a0bf84d17/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Start _get_guest_xml network_info=[{"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '47c66987-af59-4215-b4c2-63f11da6093e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvzRfCyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1cdacf7e-1d4d-4e58-857a-f70a0bf84d17', 'attached_at': '', 'detached_at': '', 'volume_id': '8227d1ba-6670-4189-85dd-7d91a9409e5d', 'serial': '8227d1ba-6670-4189-85dd-7d91a9409e5d'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:20:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:20:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvzRfCyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:20:08 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:20:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:20:08 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:20:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:20:08 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0a5980-b2d2-44e2-b66a-ece0d90559d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:20:08 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5947dfdd-845b-4e9e-9f11-2f67f30e4e7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d] added
Aug 15 02:20:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee45e13-cbf3-44b9-9980-b05cdc46c1b2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1472b63-0cf0-45c2-b95e-5deefa5d1087]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvzRfCyc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TvzRfCyc" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86aada0-aa7a-4bff-bae7-7d225b51988a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TvzRfCyc'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33e79ad-04c1-454e-aee7-d12b51de787f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa22423-78b6-47b2-b0cf-b176fd80ca6e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:20:09 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:20:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:20:09 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:20:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ea4c16-4a32-49f4-a643-9229ca1fac47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260]
Aug 15 02:20:09 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260] successful.
Aug 15 02:20:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca77911-b28d-4741-8c2c-0cc2046a50b6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1fedb2-30a7-4c25-aa85-d2a765af6c24]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:20:09 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:20:09 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:20:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:20:09 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:20:09 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:20:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[598754af-d7db-45f6-b340-7254352d5789]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:20:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvzRfCyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23230393735316463', 'path': '/dev/sdd'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230393735316463', 'path': '/dev/sdd'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-37434961',display_name='tempest-TestVolumeBootPattern-server-37434961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-37434961',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuKaje8XOyRteWQDYhsHPlBp1Xjeq99eSrwstRwpVv8kz+qsXnyj4MM3934HkKDRT/PtguSeoZK5bF8tR96SJXazwgYAgV+WiBSzEqWb7KFKLbBhYz1ys01ett7El1jYw==',key_name='tempest-TestVolumeBootPattern-929875393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-tu3ub5w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:19:58Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=1cdacf7e-1d4d-4e58-857a-f70a0bf84d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d971bce8-66de-4835-b772-b89e99985897,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971bce8-66') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:20:10 user nova-compute[73121]:   <uuid>1cdacf7e-1d4d-4e58-857a-f70a0bf84d17</uuid>
Aug 15 02:20:10 user nova-compute[73121]:   <name>instance-00000029</name>
Aug 15 02:20:10 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:20:10 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:20:10 user nova-compute[73121]:   <metadata>
Aug 15 02:20:10 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:20:10 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:20:10 user nova-compute[73121]:       <nova:name>tempest-TestVolumeBootPattern-server-37434961</nova:name>
Aug 15 02:20:10 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:20:08</nova:creationTime>
Aug 15 02:20:10 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:20:10 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:20:10 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:20:10 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:20:10 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:20:10 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:20:10 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:20:10 user nova-compute[73121]:       <nova:owner>
Aug 15 02:20:10 user nova-compute[73121]:         <nova:user uuid="9f9c4f2ffebb440cb88132a502d51811">tempest-TestVolumeBootPattern-151395753-project-member</nova:user>
Aug 15 02:20:10 user nova-compute[73121]:         <nova:project uuid="2e3397dd14ca44c19dc4386aec30a9a4">tempest-TestVolumeBootPattern-151395753</nova:project>
Aug 15 02:20:10 user nova-compute[73121]:       </nova:owner>
Aug 15 02:20:10 user nova-compute[73121]:       <nova:ports>
Aug 15 02:20:10 user nova-compute[73121]:         <nova:port uuid="d971bce8-66de-4835-b772-b89e99985897">
Aug 15 02:20:10 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 02:20:10 user nova-compute[73121]:         </nova:port>
Aug 15 02:20:10 user nova-compute[73121]:       </nova:ports>
Aug 15 02:20:10 user nova-compute[73121]:     </nova:instance>
Aug 15 02:20:10 user nova-compute[73121]:   </metadata>
Aug 15 02:20:10 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:20:10 user nova-compute[73121]:     <system>
Aug 15 02:20:10 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:20:10 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:20:10 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:20:10 user nova-compute[73121]:       <entry name="serial">1cdacf7e-1d4d-4e58-857a-f70a0bf84d17</entry>
Aug 15 02:20:10 user nova-compute[73121]:       <entry name="uuid">1cdacf7e-1d4d-4e58-857a-f70a0bf84d17</entry>
Aug 15 02:20:10 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:20:10 user nova-compute[73121]:     </system>
Aug 15 02:20:10 user nova-compute[73121]:   </sysinfo>
Aug 15 02:20:10 user nova-compute[73121]:   <os>
Aug 15 02:20:10 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:20:10 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:20:10 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:20:10 user nova-compute[73121]:   </os>
Aug 15 02:20:10 user nova-compute[73121]:   <features>
Aug 15 02:20:10 user nova-compute[73121]:     <acpi/>
Aug 15 02:20:10 user nova-compute[73121]:     <apic/>
Aug 15 02:20:10 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:20:10 user nova-compute[73121]:   </features>
Aug 15 02:20:10 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:20:10 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:20:10 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:20:10 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:20:10 user nova-compute[73121]:   </clock>
Aug 15 02:20:10 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:20:10 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:20:10 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:20:10 user nova-compute[73121]:   </cpu>
Aug 15 02:20:10 user nova-compute[73121]:   <devices>
Aug 15 02:20:10 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:20:10 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:20:10 user nova-compute[73121]:       <source dev="/dev/sdd"/>
Aug 15 02:20:10 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:20:10 user nova-compute[73121]:       <serial>8227d1ba-6670-4189-85dd-7d91a9409e5d</serial>
Aug 15 02:20:10 user nova-compute[73121]:     </disk>
Aug 15 02:20:10 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:20:10 user nova-compute[73121]:       <mac address="fa:16:3e:e0:7e:9f"/>
Aug 15 02:20:10 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:20:10 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:20:10 user nova-compute[73121]:       <target dev="tapd971bce8-66"/>
Aug 15 02:20:10 user nova-compute[73121]:     </interface>
Aug 15 02:20:10 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:20:10 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/1cdacf7e-1d4d-4e58-857a-f70a0bf84d17/console.log" append="off"/>
Aug 15 02:20:10 user nova-compute[73121]:     </serial>
Aug 15 02:20:10 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:20:10 user nova-compute[73121]:     <video>
Aug 15 02:20:10 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:20:10 user nova-compute[73121]:     </video>
Aug 15 02:20:10 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:20:10 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:20:10 user nova-compute[73121]:     </rng>
Aug 15 02:20:10 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:20:10 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:20:10 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:20:10 user nova-compute[73121]:     </memballoon>
Aug 15 02:20:10 user nova-compute[73121]:   </devices>
Aug 15 02:20:10 user nova-compute[73121]: </domain>
Aug 15 02:20:10 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-37434961',display_name='tempest-TestVolumeBootPattern-server-37434961',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-37434961',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuKaje8XOyRteWQDYhsHPlBp1Xjeq99eSrwstRwpVv8kz+qsXnyj4MM3934HkKDRT/PtguSeoZK5bF8tR96SJXazwgYAgV+WiBSzEqWb7KFKLbBhYz1ys01ett7El1jYw==',key_name='tempest-TestVolumeBootPattern-929875393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-tu3ub5w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:19:58Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=1cdacf7e-1d4d-4e58-857a-f70a0bf84d17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d971bce8-66de-4835-b772-b89e99985897,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971bce8-66') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG os_vif [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d971bce8-66de-4835-b772-b89e99985897,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971bce8-66') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd971bce8-66, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd971bce8-66, col_values=(('external_ids', {'iface-id': 'd971bce8-66de-4835-b772-b89e99985897', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:7e:9f', 'vm-uuid': '1cdacf7e-1d4d-4e58-857a-f70a0bf84d17'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:10 user nova-compute[73121]: INFO os_vif [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:7e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d971bce8-66de-4835-b772-b89e99985897,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971bce8-66')
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:20:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No VIF found with MAC fa:16:3e:e0:7e:9f, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:20:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-e4b49a82-687a-4451-8bb9-c80826b45ec7 req-5a76fe4a-e573-4906-ab08-af9ce99bfdf1 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received event network-vif-plugged-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:20:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e4b49a82-687a-4451-8bb9-c80826b45ec7 req-5a76fe4a-e573-4906-ab08-af9ce99bfdf1 service nova] Acquiring lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e4b49a82-687a-4451-8bb9-c80826b45ec7 req-5a76fe4a-e573-4906-ab08-af9ce99bfdf1 service nova] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e4b49a82-687a-4451-8bb9-c80826b45ec7 req-5a76fe4a-e573-4906-ab08-af9ce99bfdf1 service nova] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-e4b49a82-687a-4451-8bb9-c80826b45ec7 req-5a76fe4a-e573-4906-ab08-af9ce99bfdf1 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] No waiting events found dispatching network-vif-plugged-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:20:11 user nova-compute[73121]: WARNING nova.compute.manager [req-e4b49a82-687a-4451-8bb9-c80826b45ec7 req-5a76fe4a-e573-4906-ab08-af9ce99bfdf1 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received unexpected event network-vif-plugged-d971bce8-66de-4835-b772-b89e99985897 for instance with vm_state building and task_state spawning.
Aug 15 02:20:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066013.865379, 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:20:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] VM Resumed (Lifecycle Event)
Aug 15 02:20:13 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Instance spawned successfully.
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:20:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066013.8654907, 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:20:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] VM Started (Lifecycle Event)
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692065998.9430876, ad8b33e3-c58c-4182-a43a-248f5f1face1 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:20:13 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] VM Stopped (Lifecycle Event)
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:20:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-4dd825d9-8665-4f30-b1dd-293e2bf9e458 None None] [instance: ad8b33e3-c58c-4182-a43a-248f5f1face1] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:20:14 user nova-compute[73121]: DEBUG nova.compute.manager [req-1b0496c2-89b2-4899-9090-57b020c1eee6 req-2453cd0e-1d25-418f-b589-e15d62dc3182 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received event network-vif-plugged-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:20:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1b0496c2-89b2-4899-9090-57b020c1eee6 req-2453cd0e-1d25-418f-b589-e15d62dc3182 service nova] Acquiring lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1b0496c2-89b2-4899-9090-57b020c1eee6 req-2453cd0e-1d25-418f-b589-e15d62dc3182 service nova] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1b0496c2-89b2-4899-9090-57b020c1eee6 req-2453cd0e-1d25-418f-b589-e15d62dc3182 service nova] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:14 user nova-compute[73121]: DEBUG nova.compute.manager [req-1b0496c2-89b2-4899-9090-57b020c1eee6 req-2453cd0e-1d25-418f-b589-e15d62dc3182 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] No waiting events found dispatching network-vif-plugged-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:20:14 user nova-compute[73121]: WARNING nova.compute.manager [req-1b0496c2-89b2-4899-9090-57b020c1eee6 req-2453cd0e-1d25-418f-b589-e15d62dc3182 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received unexpected event network-vif-plugged-d971bce8-66de-4835-b772-b89e99985897 for instance with vm_state building and task_state spawning.
Aug 15 02:20:14 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:20:14 user nova-compute[73121]: INFO nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Took 5.17 seconds to spawn the instance on the hypervisor.
Aug 15 02:20:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:20:14 user nova-compute[73121]: INFO nova.compute.manager [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Took 16.53 seconds to build instance.
Aug 15 02:20:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2c99b4c8-6d96-4abb-8c4f-9fcf1265942d tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.650s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:20:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:20:30 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:32 user nova-compute[73121]: INFO nova.compute.manager [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Unshelving
Aug 15 02:20:32 user nova-compute[73121]: INFO nova.virt.block_device [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Booting with volume 1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 at /dev/vdc
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG os_brick.utils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d77a218-b612-43e4-98c3-c1980ef0ee01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c249f12a-9abe-4efd-90fd-a08af6d01418]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d700a2a-2481-4d92-93fc-9fe93c666914]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fbd3fd-7b5d-47da-b703-94956faba30c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:20:32 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:20:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e90a0-b4f3-4d2a-81a7-0ab522b12a62]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG os_brick.utils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:20:32 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating existing volume attachment record: edc57ee4-ba30-4885-833b-9337c2806722 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:20:33 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:20:33 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7764MB free_disk=25.336353302001953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Applying migration context for instance 454e5897-0179-41fb-a58d-c264831ee4a9 as it has an incoming, in-progress migration 99d635e8-969e-4c08-b8c7-eba1f02508c6. Migration status is finished {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 02:20:33 user nova-compute[73121]: INFO nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating resource usage from migration 99d635e8-969e-4c08-b8c7-eba1f02508c6
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Migration 99d635e8-969e-4c08-b8c7-eba1f02508c6 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 454e5897-0179-41fb-a58d-c264831ee4a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 62fc764f-1ca0-4916-ab0f-b822c9070c8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:20:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:20:34 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:20:34 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:20:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:20:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:20:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:42 user nova-compute[73121]: DEBUG nova.objects.instance [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'pci_requests' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:20:42 user nova-compute[73121]: DEBUG nova.objects.instance [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'numa_topology' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:20:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:20:42 user nova-compute[73121]: INFO nova.compute.claims [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Claim successful on node user
Aug 15 02:20:42 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:20:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:20:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:42 user nova-compute[73121]: INFO nova.network.neutron [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating port a6084f1b-a315-4de8-a572-5cf33a871c66 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 02:20:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:20:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquired lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:20:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:20:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-3907418b-aa3e-4885-a9d2-348b21213723 req-b07cc905-4722-4f3c-84fc-d3da4dd97194 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-changed-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:20:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-3907418b-aa3e-4885-a9d2-348b21213723 req-b07cc905-4722-4f3c-84fc-d3da4dd97194 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Refreshing instance network info cache due to event network-changed-a6084f1b-a315-4de8-a572-5cf33a871c66. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:20:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3907418b-aa3e-4885-a9d2-348b21213723 req-b07cc905-4722-4f3c-84fc-d3da4dd97194 service nova] Acquiring lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:20:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating instance_info_cache with network_info: [{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:20:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Releasing lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:20:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:20:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Creating image(s)
Aug 15 02:20:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:44 user nova-compute[73121]: DEBUG nova.objects.instance [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'trusted_certs' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:20:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3907418b-aa3e-4885-a9d2-348b21213723 req-b07cc905-4722-4f3c-84fc-d3da4dd97194 service nova] Acquired lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:20:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-3907418b-aa3e-4885-a9d2-348b21213723 req-b07cc905-4722-4f3c-84fc-d3da4dd97194 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Refreshing network info cache for port a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:20:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "8c74a1dcce6763897340bedd478a28e98d0e65c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "8c74a1dcce6763897340bedd478a28e98d0e65c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0.part --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG nova.virt.images [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] d631529d-3cbf-4b30-b8cc-d2a467df71b0 was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0.part /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG nova.network.neutron [req-3907418b-aa3e-4885-a9d2-348b21213723 req-b07cc905-4722-4f3c-84fc-d3da4dd97194 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updated VIF entry in instance network info cache for port a6084f1b-a315-4de8-a572-5cf33a871c66. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG nova.network.neutron [req-3907418b-aa3e-4885-a9d2-348b21213723 req-b07cc905-4722-4f3c-84fc-d3da4dd97194 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating instance_info_cache with network_info: [{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0.part /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0.converted" returned: 0 in 0.420s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3907418b-aa3e-4885-a9d2-348b21213723 req-b07cc905-4722-4f3c-84fc-d3da4dd97194 service nova] Releasing lock "refresh_cache-62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "8c74a1dcce6763897340bedd478a28e98d0e65c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.942s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0 --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "8c74a1dcce6763897340bedd478a28e98d0e65c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "8c74a1dcce6763897340bedd478a28e98d0e65c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0 --force-share --output=json" returned: 0 in 0.226s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0,backing_fmt=raw /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0,backing_fmt=raw /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk 1073741824" returned: 0 in 0.108s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "8c74a1dcce6763897340bedd478a28e98d0e65c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.341s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0 --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG nova.objects.instance [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'migration_context' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:20:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Rebasing disk image.
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a -F raw /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a -F raw /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk" returned: 0 in 2.002s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Ensure instance console log exists: /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Start _get_guest_xml network_info=[{"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='74231c99adb5dc072cff175a8706bc69',container_format='bare',created_at=2023-08-15T02:18:40Z,direct_url=<?>,disk_format='qcow2',id=d631529d-3cbf-4b30-b8cc-d2a467df71b0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-999784560-shelved',owner='203875f0947a423faf1ae9930f401026',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T02:18:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'edc57ee4-ba30-4885-833b-9337c2806722', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avFCpunz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7', 'attached_at': '', 'detached_at': '', 'volume_id': '1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2', 'serial': '1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:20:48 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:20:48 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='74231c99adb5dc072cff175a8706bc69',container_format='bare',created_at=2023-08-15T02:18:40Z,direct_url=<?>,disk_format='qcow2',id=d631529d-3cbf-4b30-b8cc-d2a467df71b0,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-999784560-shelved',owner='203875f0947a423faf1ae9930f401026',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T02:18:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.objects.instance [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'vcpu_model' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avFCpunz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:20:48 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:20:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:20:48 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:20:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:20:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:20:48 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:20:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eeada8d-08a7-428a-a61e-da4a55194524]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:20:49 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e3428a-a848-4168-8f5b-eafb02a11feb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2] added
Aug 15 02:20:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.139s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe35e868-e1a9-4d72-a607-fc111459bfe8]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dad73eb-0a48-481a-a93d-9e63f0d5e463]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avFCpunz {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avFCpunz" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd5d7a6-ac20-4790-b768-1ff8f1e6bcc9]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'avFCpunz'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.061s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e7cdfe-c6c7-46d2-a4c0-3f88b3b8c050]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.061s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d701a1a-ca89-475f-b8b4-cf15939dec74]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:20:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:20:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --login" returned: 0 in 0.145s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c1cac7-c206-4621-a11a-7cf4e4fdee7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2, portal: 172.16.0.220,3260]
Aug 15 02:20:49 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2, portal: 172.16.0.220,3260] successful.
Aug 15 02:20:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.123s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d373ab5-6be0-49f9-8645-49e04aa1ce87]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c229dcd-7a1c-4d6e-a6e8-2b8669a04e8f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:20:49 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:20:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.758s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] HCTL ('36', '-', '-', 0) found on session 52 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a181b6b-93fa-4862-a666-6ee0a530c5ea]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Searching for a device in session 52 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:20:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avFCpunz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.808s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] <== connect_volume: return (1810ms) {'type': 'block', 'scsi_wwn': '26637353538316239', 'path': '/dev/sde'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637353538316239', 'path': '/dev/sde'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-999784560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-999784560',id=36,image_ref='d631529d-3cbf-4b30-b8cc-d2a467df71b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-307324577',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-4snqcx1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member',shelved_at='2023-08-15T02:18:44.727053',shelved_host='user',shelved_image_id='d631529d-3cbf-4b30-b8cc-d2a467df71b0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.objects.instance [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'pci_devices' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:20:50 user nova-compute[73121]:   <uuid>62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7</uuid>
Aug 15 02:20:50 user nova-compute[73121]:   <name>instance-00000024</name>
Aug 15 02:20:50 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:20:50 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:20:50 user nova-compute[73121]:   <metadata>
Aug 15 02:20:50 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:20:50 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:20:50 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-999784560</nova:name>
Aug 15 02:20:50 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:20:48</nova:creationTime>
Aug 15 02:20:50 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:20:50 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:20:50 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:20:50 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:20:50 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:20:50 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:20:50 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:20:50 user nova-compute[73121]:       <nova:owner>
Aug 15 02:20:50 user nova-compute[73121]:         <nova:user uuid="6321528a357e45878a851a10e78226a4">tempest-AttachVolumeShelveTestJSON-201192507-project-member</nova:user>
Aug 15 02:20:50 user nova-compute[73121]:         <nova:project uuid="203875f0947a423faf1ae9930f401026">tempest-AttachVolumeShelveTestJSON-201192507</nova:project>
Aug 15 02:20:50 user nova-compute[73121]:       </nova:owner>
Aug 15 02:20:50 user nova-compute[73121]:       <nova:root type="image" uuid="d631529d-3cbf-4b30-b8cc-d2a467df71b0"/>
Aug 15 02:20:50 user nova-compute[73121]:       <nova:ports>
Aug 15 02:20:50 user nova-compute[73121]:         <nova:port uuid="a6084f1b-a315-4de8-a572-5cf33a871c66">
Aug 15 02:20:50 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:20:50 user nova-compute[73121]:         </nova:port>
Aug 15 02:20:50 user nova-compute[73121]:       </nova:ports>
Aug 15 02:20:50 user nova-compute[73121]:     </nova:instance>
Aug 15 02:20:50 user nova-compute[73121]:   </metadata>
Aug 15 02:20:50 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:20:50 user nova-compute[73121]:     <system>
Aug 15 02:20:50 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:20:50 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:20:50 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:20:50 user nova-compute[73121]:       <entry name="serial">62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7</entry>
Aug 15 02:20:50 user nova-compute[73121]:       <entry name="uuid">62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7</entry>
Aug 15 02:20:50 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:20:50 user nova-compute[73121]:     </system>
Aug 15 02:20:50 user nova-compute[73121]:   </sysinfo>
Aug 15 02:20:50 user nova-compute[73121]:   <os>
Aug 15 02:20:50 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:20:50 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:20:50 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:20:50 user nova-compute[73121]:   </os>
Aug 15 02:20:50 user nova-compute[73121]:   <features>
Aug 15 02:20:50 user nova-compute[73121]:     <acpi/>
Aug 15 02:20:50 user nova-compute[73121]:     <apic/>
Aug 15 02:20:50 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:20:50 user nova-compute[73121]:   </features>
Aug 15 02:20:50 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:20:50 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:20:50 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:20:50 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:20:50 user nova-compute[73121]:   </clock>
Aug 15 02:20:50 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:20:50 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:20:50 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:20:50 user nova-compute[73121]:   </cpu>
Aug 15 02:20:50 user nova-compute[73121]:   <devices>
Aug 15 02:20:50 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:20:50 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:20:50 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk"/>
Aug 15 02:20:50 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:20:50 user nova-compute[73121]:     </disk>
Aug 15 02:20:50 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:20:50 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:20:50 user nova-compute[73121]:       <source dev="/dev/sde"/>
Aug 15 02:20:50 user nova-compute[73121]:       <target dev="vdc" bus="virtio"/>
Aug 15 02:20:50 user nova-compute[73121]:       <serial>1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2</serial>
Aug 15 02:20:50 user nova-compute[73121]:     </disk>
Aug 15 02:20:50 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:20:50 user nova-compute[73121]:       <mac address="fa:16:3e:d0:4e:de"/>
Aug 15 02:20:50 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:20:50 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:20:50 user nova-compute[73121]:       <target dev="tapa6084f1b-a3"/>
Aug 15 02:20:50 user nova-compute[73121]:     </interface>
Aug 15 02:20:50 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:20:50 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/console.log" append="off"/>
Aug 15 02:20:50 user nova-compute[73121]:     </serial>
Aug 15 02:20:50 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:20:50 user nova-compute[73121]:     <video>
Aug 15 02:20:50 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:20:50 user nova-compute[73121]:     </video>
Aug 15 02:20:50 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:20:50 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:20:50 user nova-compute[73121]:     </rng>
Aug 15 02:20:50 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:20:50 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:20:50 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:20:50 user nova-compute[73121]:     </memballoon>
Aug 15 02:20:50 user nova-compute[73121]:   </devices>
Aug 15 02:20:50 user nova-compute[73121]: </domain>
Aug 15 02:20:50 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-999784560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-999784560',id=36,image_ref='d631529d-3cbf-4b30-b8cc-d2a467df71b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-307324577',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:16:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-4snqcx1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member',shelved_at='2023-08-15T02:18:44.727053',shelved_host='user',shelved_image_id='d631529d-3cbf-4b30-b8cc-d2a467df71b0'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:20:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG os_vif [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6084f1b-a3, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa6084f1b-a3, col_values=(('external_ids', {'iface-id': 'a6084f1b-a315-4de8-a572-5cf33a871c66', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:4e:de', 'vm-uuid': '62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:50 user nova-compute[73121]: INFO os_vif [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3')
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:20:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] No VIF found with MAC fa:16:3e:d0:4e:de, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:20:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-7e21abce-4290-4182-883a-da0bba7a4dae req-5eaa659a-7b07-46b2-a08a-899805d516b4 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:20:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7e21abce-4290-4182-883a-da0bba7a4dae req-5eaa659a-7b07-46b2-a08a-899805d516b4 service nova] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7e21abce-4290-4182-883a-da0bba7a4dae req-5eaa659a-7b07-46b2-a08a-899805d516b4 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7e21abce-4290-4182-883a-da0bba7a4dae req-5eaa659a-7b07-46b2-a08a-899805d516b4 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-7e21abce-4290-4182-883a-da0bba7a4dae req-5eaa659a-7b07-46b2-a08a-899805d516b4 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] No waiting events found dispatching network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:20:52 user nova-compute[73121]: WARNING nova.compute.manager [req-7e21abce-4290-4182-883a-da0bba7a4dae req-5eaa659a-7b07-46b2-a08a-899805d516b4 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received unexpected event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 02:20:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Going to confirm migration 1 {{(pid=73121) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquired lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'info_cache' on Instance uuid 454e5897-0179-41fb-a58d-c264831ee4a9 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating instance_info_cache with network_info: [{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Releasing lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:20:53 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'migration_context' on Instance uuid 454e5897-0179-41fb-a58d-c264831ee4a9 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:20:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:20:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.315s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:54 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Deleted allocation for migration 99d635e8-969e-4c08-b8c7-eba1f02508c6
Aug 15 02:20:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b48d5889-e575-4dc4-b1d7-3e4a0892d213 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.412s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066054.8684592, 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:20:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] VM Resumed (Lifecycle Event)
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:20:54 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance spawned successfully.
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:20:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066054.8737178, 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:20:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] VM Started (Lifecycle Event)
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:20:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:20:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:20:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-fb9c2e4f-0947-4d4d-8585-b958e6ad808f req-f4c924f2-06ec-46e5-88c5-c48295e8a86c service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:20:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fb9c2e4f-0947-4d4d-8585-b958e6ad808f req-f4c924f2-06ec-46e5-88c5-c48295e8a86c service nova] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:20:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fb9c2e4f-0947-4d4d-8585-b958e6ad808f req-f4c924f2-06ec-46e5-88c5-c48295e8a86c service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:20:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fb9c2e4f-0947-4d4d-8585-b958e6ad808f req-f4c924f2-06ec-46e5-88c5-c48295e8a86c service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-fb9c2e4f-0947-4d4d-8585-b958e6ad808f req-f4c924f2-06ec-46e5-88c5-c48295e8a86c service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] No waiting events found dispatching network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:20:55 user nova-compute[73121]: WARNING nova.compute.manager [req-fb9c2e4f-0947-4d4d-8585-b958e6ad808f req-f4c924f2-06ec-46e5-88c5-c48295e8a86c service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received unexpected event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 02:20:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:20:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-91591713-0b4b-4870-9ffa-b6cf1cb7c6f7 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.767s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:20:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:20:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:21:04 user nova-compute[73121]: INFO nova.compute.claims [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Claim successful on node user
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:21:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:21:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Creating image(s)
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.policy [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5012859ad374ac0b441cc5a5739cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c202114f5c584284a72d52cececc4b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:21:05 user nova-compute[73121]: INFO nova.compute.claims [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Claim successful on node user
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.228s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk 1073741824" returned: 0 in 0.107s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.249s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.704s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Successfully created port: db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:21:05 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Cannot resize image /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:21:05 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'migration_context' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Ensure instance console log exists: /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:21:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Creating image(s)
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG nova.policy [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5012859ad374ac0b441cc5a5739cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c202114f5c584284a72d52cececc4b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.291s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.219s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk 1073741824" returned: 0 in 0.076s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:06 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Successfully updated port: db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.234s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquired lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-fab1efcd-333c-4872-848d-bae43a442ee2 req-ceee9cdf-99f0-40fb-84be-33218432dbe6 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-changed-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-fab1efcd-333c-4872-848d-bae43a442ee2 req-ceee9cdf-99f0-40fb-84be-33218432dbe6 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Refreshing instance network info cache due to event network-changed-db197fcc-d147-49fa-9c46-9f330534c0e6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fab1efcd-333c-4872-848d-bae43a442ee2 req-ceee9cdf-99f0-40fb-84be-33218432dbe6 service nova] Acquiring lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Cannot resize image /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.objects.instance [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'migration_context' on Instance uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Ensure instance console log exists: /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Successfully created port: d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updating instance_info_cache with network_info: [{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Releasing lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Instance network_info: |[{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fab1efcd-333c-4872-848d-bae43a442ee2 req-ceee9cdf-99f0-40fb-84be-33218432dbe6 service nova] Acquired lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.network.neutron [req-fab1efcd-333c-4872-848d-bae43a442ee2 req-ceee9cdf-99f0-40fb-84be-33218432dbe6 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Refreshing network info cache for port db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Start _get_guest_xml network_info=[{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:21:07 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:21:07 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1658867354',display_name='tempest-ServerRescueNegativeTestJSON-server-1658867354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1658867354',id=42,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-9i9zxafu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:21:05Z,user_data=None,user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=6ecfcc84-d915-4eac-bbf6-9ab2b5782088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b9:e2,bridge_name='br-int',has_traffic_filtering=True,id=db197fcc-d147-49fa-9c46-9f330534c0e6,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb197fcc-d1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:21:07 user nova-compute[73121]:   <uuid>6ecfcc84-d915-4eac-bbf6-9ab2b5782088</uuid>
Aug 15 02:21:07 user nova-compute[73121]:   <name>instance-0000002a</name>
Aug 15 02:21:07 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:21:07 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:21:07 user nova-compute[73121]:   <metadata>
Aug 15 02:21:07 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:21:07 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:21:07 user nova-compute[73121]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1658867354</nova:name>
Aug 15 02:21:07 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:21:07</nova:creationTime>
Aug 15 02:21:07 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:21:07 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:21:07 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:21:07 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:21:07 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:21:07 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:21:07 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:21:07 user nova-compute[73121]:       <nova:owner>
Aug 15 02:21:07 user nova-compute[73121]:         <nova:user uuid="c5012859ad374ac0b441cc5a5739cf4e">tempest-ServerRescueNegativeTestJSON-704093322-project-member</nova:user>
Aug 15 02:21:07 user nova-compute[73121]:         <nova:project uuid="c202114f5c584284a72d52cececc4b34">tempest-ServerRescueNegativeTestJSON-704093322</nova:project>
Aug 15 02:21:07 user nova-compute[73121]:       </nova:owner>
Aug 15 02:21:07 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:21:07 user nova-compute[73121]:       <nova:ports>
Aug 15 02:21:07 user nova-compute[73121]:         <nova:port uuid="db197fcc-d147-49fa-9c46-9f330534c0e6">
Aug 15 02:21:07 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:21:07 user nova-compute[73121]:         </nova:port>
Aug 15 02:21:07 user nova-compute[73121]:       </nova:ports>
Aug 15 02:21:07 user nova-compute[73121]:     </nova:instance>
Aug 15 02:21:07 user nova-compute[73121]:   </metadata>
Aug 15 02:21:07 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:21:07 user nova-compute[73121]:     <system>
Aug 15 02:21:07 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:21:07 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:21:07 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:21:07 user nova-compute[73121]:       <entry name="serial">6ecfcc84-d915-4eac-bbf6-9ab2b5782088</entry>
Aug 15 02:21:07 user nova-compute[73121]:       <entry name="uuid">6ecfcc84-d915-4eac-bbf6-9ab2b5782088</entry>
Aug 15 02:21:07 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:21:07 user nova-compute[73121]:     </system>
Aug 15 02:21:07 user nova-compute[73121]:   </sysinfo>
Aug 15 02:21:07 user nova-compute[73121]:   <os>
Aug 15 02:21:07 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:21:07 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:21:07 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:21:07 user nova-compute[73121]:   </os>
Aug 15 02:21:07 user nova-compute[73121]:   <features>
Aug 15 02:21:07 user nova-compute[73121]:     <acpi/>
Aug 15 02:21:07 user nova-compute[73121]:     <apic/>
Aug 15 02:21:07 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:21:07 user nova-compute[73121]:   </features>
Aug 15 02:21:07 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:21:07 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:21:07 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:21:07 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:21:07 user nova-compute[73121]:   </clock>
Aug 15 02:21:07 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:21:07 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:21:07 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:21:07 user nova-compute[73121]:   </cpu>
Aug 15 02:21:07 user nova-compute[73121]:   <devices>
Aug 15 02:21:07 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:21:07 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:21:07 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk"/>
Aug 15 02:21:07 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:21:07 user nova-compute[73121]:     </disk>
Aug 15 02:21:07 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:21:07 user nova-compute[73121]:       <mac address="fa:16:3e:bc:b9:e2"/>
Aug 15 02:21:07 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:21:07 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:21:07 user nova-compute[73121]:       <target dev="tapdb197fcc-d1"/>
Aug 15 02:21:07 user nova-compute[73121]:     </interface>
Aug 15 02:21:07 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:21:07 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/console.log" append="off"/>
Aug 15 02:21:07 user nova-compute[73121]:     </serial>
Aug 15 02:21:07 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:21:07 user nova-compute[73121]:     <video>
Aug 15 02:21:07 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:21:07 user nova-compute[73121]:     </video>
Aug 15 02:21:07 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:21:07 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:21:07 user nova-compute[73121]:     </rng>
Aug 15 02:21:07 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:21:07 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:21:07 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:21:07 user nova-compute[73121]:     </memballoon>
Aug 15 02:21:07 user nova-compute[73121]:   </devices>
Aug 15 02:21:07 user nova-compute[73121]: </domain>
Aug 15 02:21:07 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1658867354',display_name='tempest-ServerRescueNegativeTestJSON-server-1658867354',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1658867354',id=42,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-9i9zxafu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:21:05Z,user_data=None,user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=6ecfcc84-d915-4eac-bbf6-9ab2b5782088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b9:e2,bridge_name='br-int',has_traffic_filtering=True,id=db197fcc-d147-49fa-9c46-9f330534c0e6,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb197fcc-d1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG os_vif [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b9:e2,bridge_name='br-int',has_traffic_filtering=True,id=db197fcc-d147-49fa-9c46-9f330534c0e6,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb197fcc-d1') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb197fcc-d1, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb197fcc-d1, col_values=(('external_ids', {'iface-id': 'db197fcc-d147-49fa-9c46-9f330534c0e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:b9:e2', 'vm-uuid': '6ecfcc84-d915-4eac-bbf6-9ab2b5782088'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:07 user nova-compute[73121]: INFO os_vif [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:b9:e2,bridge_name='br-int',has_traffic_filtering=True,id=db197fcc-d147-49fa-9c46-9f330534c0e6,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb197fcc-d1')
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No VIF found with MAC fa:16:3e:bc:b9:e2, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:21:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-fab1efcd-333c-4872-848d-bae43a442ee2 req-ceee9cdf-99f0-40fb-84be-33218432dbe6 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updated VIF entry in instance network info cache for port db197fcc-d147-49fa-9c46-9f330534c0e6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-fab1efcd-333c-4872-848d-bae43a442ee2 req-ceee9cdf-99f0-40fb-84be-33218432dbe6 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updating instance_info_cache with network_info: [{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fab1efcd-333c-4872-848d-bae43a442ee2 req-ceee9cdf-99f0-40fb-84be-33218432dbe6 service nova] Releasing lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Successfully updated port: d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquired lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-4677c327-6086-4f01-bb2f-03141e9c67c3 req-9842d00e-0926-41ab-9558-4a4b106f3c73 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-changed-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-4677c327-6086-4f01-bb2f-03141e9c67c3 req-9842d00e-0926-41ab-9558-4a4b106f3c73 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Refreshing instance network info cache due to event network-changed-d0508681-b710-480c-9533-73fdf1cb3d7d. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:21:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4677c327-6086-4f01-bb2f-03141e9c67c3 req-9842d00e-0926-41ab-9558-4a4b106f3c73 service nova] Acquiring lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.network.neutron [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updating instance_info_cache with network_info: [{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Releasing lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Instance network_info: |[{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4677c327-6086-4f01-bb2f-03141e9c67c3 req-9842d00e-0926-41ab-9558-4a4b106f3c73 service nova] Acquired lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-4677c327-6086-4f01-bb2f-03141e9c67c3 req-9842d00e-0926-41ab-9558-4a4b106f3c73 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Refreshing network info cache for port d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Start _get_guest_xml network_info=[{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:21:09 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:21:09 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-841237313',display_name='tempest-ServerRescueNegativeTestJSON-server-841237313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-841237313',id=43,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-t8g0dkoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:21:06Z,user_data=None,user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=22339f3c-9ef1-4630-94c2-a56f0b97aba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:dc:15,bridge_name='br-int',has_traffic_filtering=True,id=d0508681-b710-480c-9533-73fdf1cb3d7d,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0508681-b7') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'pci_devices' on Instance uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:21:09 user nova-compute[73121]:   <uuid>22339f3c-9ef1-4630-94c2-a56f0b97aba6</uuid>
Aug 15 02:21:09 user nova-compute[73121]:   <name>instance-0000002b</name>
Aug 15 02:21:09 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:21:09 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:21:09 user nova-compute[73121]:   <metadata>
Aug 15 02:21:09 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:21:09 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:21:09 user nova-compute[73121]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-841237313</nova:name>
Aug 15 02:21:09 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:21:09</nova:creationTime>
Aug 15 02:21:09 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:21:09 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:21:09 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:21:09 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:21:09 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:21:09 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:21:09 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:21:09 user nova-compute[73121]:       <nova:owner>
Aug 15 02:21:09 user nova-compute[73121]:         <nova:user uuid="c5012859ad374ac0b441cc5a5739cf4e">tempest-ServerRescueNegativeTestJSON-704093322-project-member</nova:user>
Aug 15 02:21:09 user nova-compute[73121]:         <nova:project uuid="c202114f5c584284a72d52cececc4b34">tempest-ServerRescueNegativeTestJSON-704093322</nova:project>
Aug 15 02:21:09 user nova-compute[73121]:       </nova:owner>
Aug 15 02:21:09 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:21:09 user nova-compute[73121]:       <nova:ports>
Aug 15 02:21:09 user nova-compute[73121]:         <nova:port uuid="d0508681-b710-480c-9533-73fdf1cb3d7d">
Aug 15 02:21:09 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 02:21:09 user nova-compute[73121]:         </nova:port>
Aug 15 02:21:09 user nova-compute[73121]:       </nova:ports>
Aug 15 02:21:09 user nova-compute[73121]:     </nova:instance>
Aug 15 02:21:09 user nova-compute[73121]:   </metadata>
Aug 15 02:21:09 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:21:09 user nova-compute[73121]:     <system>
Aug 15 02:21:09 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:21:09 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:21:09 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:21:09 user nova-compute[73121]:       <entry name="serial">22339f3c-9ef1-4630-94c2-a56f0b97aba6</entry>
Aug 15 02:21:09 user nova-compute[73121]:       <entry name="uuid">22339f3c-9ef1-4630-94c2-a56f0b97aba6</entry>
Aug 15 02:21:09 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:21:09 user nova-compute[73121]:     </system>
Aug 15 02:21:09 user nova-compute[73121]:   </sysinfo>
Aug 15 02:21:09 user nova-compute[73121]:   <os>
Aug 15 02:21:09 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:21:09 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:21:09 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:21:09 user nova-compute[73121]:   </os>
Aug 15 02:21:09 user nova-compute[73121]:   <features>
Aug 15 02:21:09 user nova-compute[73121]:     <acpi/>
Aug 15 02:21:09 user nova-compute[73121]:     <apic/>
Aug 15 02:21:09 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:21:09 user nova-compute[73121]:   </features>
Aug 15 02:21:09 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:21:09 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:21:09 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:21:09 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:21:09 user nova-compute[73121]:   </clock>
Aug 15 02:21:09 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:21:09 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:21:09 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:21:09 user nova-compute[73121]:   </cpu>
Aug 15 02:21:09 user nova-compute[73121]:   <devices>
Aug 15 02:21:09 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:21:09 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:21:09 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk"/>
Aug 15 02:21:09 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:21:09 user nova-compute[73121]:     </disk>
Aug 15 02:21:09 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:21:09 user nova-compute[73121]:       <mac address="fa:16:3e:70:dc:15"/>
Aug 15 02:21:09 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:21:09 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:21:09 user nova-compute[73121]:       <target dev="tapd0508681-b7"/>
Aug 15 02:21:09 user nova-compute[73121]:     </interface>
Aug 15 02:21:09 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:21:09 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/console.log" append="off"/>
Aug 15 02:21:09 user nova-compute[73121]:     </serial>
Aug 15 02:21:09 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:21:09 user nova-compute[73121]:     <video>
Aug 15 02:21:09 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:21:09 user nova-compute[73121]:     </video>
Aug 15 02:21:09 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:21:09 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:21:09 user nova-compute[73121]:     </rng>
Aug 15 02:21:09 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:21:09 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:21:09 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:21:09 user nova-compute[73121]:     </memballoon>
Aug 15 02:21:09 user nova-compute[73121]:   </devices>
Aug 15 02:21:09 user nova-compute[73121]: </domain>
Aug 15 02:21:09 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-841237313',display_name='tempest-ServerRescueNegativeTestJSON-server-841237313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-841237313',id=43,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-t8g0dkoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:21:06Z,user_data=None,user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=22339f3c-9ef1-4630-94c2-a56f0b97aba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:dc:15,bridge_name='br-int',has_traffic_filtering=True,id=d0508681-b710-480c-9533-73fdf1cb3d7d,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0508681-b7') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG os_vif [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:dc:15,bridge_name='br-int',has_traffic_filtering=True,id=d0508681-b710-480c-9533-73fdf1cb3d7d,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0508681-b7') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0508681-b7, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0508681-b7, col_values=(('external_ids', {'iface-id': 'd0508681-b710-480c-9533-73fdf1cb3d7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:dc:15', 'vm-uuid': '22339f3c-9ef1-4630-94c2-a56f0b97aba6'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: INFO os_vif [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:dc:15,bridge_name='br-int',has_traffic_filtering=True,id=d0508681-b710-480c-9533-73fdf1cb3d7d,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0508681-b7')
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No VIF found with MAC fa:16:3e:70:dc:15, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-12e17583-82ba-45e3-803f-f266d4a7d061 req-c5d31a46-d972-4a83-ab1a-89a943569494 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-12e17583-82ba-45e3-803f-f266d4a7d061 req-c5d31a46-d972-4a83-ab1a-89a943569494 service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-12e17583-82ba-45e3-803f-f266d4a7d061 req-c5d31a46-d972-4a83-ab1a-89a943569494 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-12e17583-82ba-45e3-803f-f266d4a7d061 req-c5d31a46-d972-4a83-ab1a-89a943569494 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-12e17583-82ba-45e3-803f-f266d4a7d061 req-c5d31a46-d972-4a83-ab1a-89a943569494 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:21:09 user nova-compute[73121]: WARNING nova.compute.manager [req-12e17583-82ba-45e3-803f-f266d4a7d061 req-c5d31a46-d972-4a83-ab1a-89a943569494 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state building and task_state spawning.
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-4677c327-6086-4f01-bb2f-03141e9c67c3 req-9842d00e-0926-41ab-9558-4a4b106f3c73 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updated VIF entry in instance network info cache for port d0508681-b710-480c-9533-73fdf1cb3d7d. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-4677c327-6086-4f01-bb2f-03141e9c67c3 req-9842d00e-0926-41ab-9558-4a4b106f3c73 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updating instance_info_cache with network_info: [{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4677c327-6086-4f01-bb2f-03141e9c67c3 req-9842d00e-0926-41ab-9558-4a4b106f3c73 service nova] Releasing lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-8d319a97-034f-416b-a820-b31ae3c7a466 req-8574e006-3328-40ba-ab1a-cb018a20465f service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8d319a97-034f-416b-a820-b31ae3c7a466 req-8574e006-3328-40ba-ab1a-cb018a20465f service nova] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8d319a97-034f-416b-a820-b31ae3c7a466 req-8574e006-3328-40ba-ab1a-cb018a20465f service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8d319a97-034f-416b-a820-b31ae3c7a466 req-8574e006-3328-40ba-ab1a-cb018a20465f service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-8d319a97-034f-416b-a820-b31ae3c7a466 req-8574e006-3328-40ba-ab1a-cb018a20465f service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] No waiting events found dispatching network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:21:11 user nova-compute[73121]: WARNING nova.compute.manager [req-8d319a97-034f-416b-a820-b31ae3c7a466 req-8574e006-3328-40ba-ab1a-cb018a20465f service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received unexpected event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d for instance with vm_state building and task_state spawning.
Aug 15 02:21:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-1573d752-9bd6-4725-84a0-e3c323b89ee2 req-e4480e7a-b6e4-42ab-abda-bc353a74942d service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1573d752-9bd6-4725-84a0-e3c323b89ee2 req-e4480e7a-b6e4-42ab-abda-bc353a74942d service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1573d752-9bd6-4725-84a0-e3c323b89ee2 req-e4480e7a-b6e4-42ab-abda-bc353a74942d service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1573d752-9bd6-4725-84a0-e3c323b89ee2 req-e4480e7a-b6e4-42ab-abda-bc353a74942d service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-1573d752-9bd6-4725-84a0-e3c323b89ee2 req-e4480e7a-b6e4-42ab-abda-bc353a74942d service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:21:11 user nova-compute[73121]: WARNING nova.compute.manager [req-1573d752-9bd6-4725-84a0-e3c323b89ee2 req-e4480e7a-b6e4-42ab-abda-bc353a74942d service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state building and task_state spawning.
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066072.6027997, 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:21:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] VM Resumed (Lifecycle Event)
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:21:12 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Instance spawned successfully.
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:21:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066072.6042707, 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:21:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] VM Started (Lifecycle Event)
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:21:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:21:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Took 7.95 seconds to spawn the instance on the hypervisor.
Aug 15 02:21:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:21:12 user nova-compute[73121]: INFO nova.compute.manager [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Took 8.77 seconds to build instance.
Aug 15 02:21:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ea24b3fb-9226-4202-bf26-2899a5d2f4e3 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.856s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066073.0097663, 22339f3c-9ef1-4630-94c2-a56f0b97aba6 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:21:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] VM Resumed (Lifecycle Event)
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:21:13 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Instance spawned successfully.
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:21:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066073.017616, 22339f3c-9ef1-4630-94c2-a56f0b97aba6 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:21:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] VM Started (Lifecycle Event)
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:21:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:21:13 user nova-compute[73121]: INFO nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Took 7.00 seconds to spawn the instance on the hypervisor.
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:21:13 user nova-compute[73121]: INFO nova.compute.manager [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Took 8.18 seconds to build instance.
Aug 15 02:21:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-15e00477-ceaa-46b2-aa02-6280f221c6be tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.268s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-a2faa13c-d895-4cec-8a7a-5ab0f7b6ae89 req-df5cd495-355d-4e18-a507-d1e0241b9669 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a2faa13c-d895-4cec-8a7a-5ab0f7b6ae89 req-df5cd495-355d-4e18-a507-d1e0241b9669 service nova] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a2faa13c-d895-4cec-8a7a-5ab0f7b6ae89 req-df5cd495-355d-4e18-a507-d1e0241b9669 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a2faa13c-d895-4cec-8a7a-5ab0f7b6ae89 req-df5cd495-355d-4e18-a507-d1e0241b9669 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-a2faa13c-d895-4cec-8a7a-5ab0f7b6ae89 req-df5cd495-355d-4e18-a507-d1e0241b9669 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] No waiting events found dispatching network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:21:13 user nova-compute[73121]: WARNING nova.compute.manager [req-a2faa13c-d895-4cec-8a7a-5ab0f7b6ae89 req-df5cd495-355d-4e18-a507-d1e0241b9669 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received unexpected event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d for instance with vm_state active and task_state None.
Aug 15 02:21:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:21:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:21:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:21:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:21:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:21:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating instance_info_cache with network_info: [{"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:21:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-454e5897-0179-41fb-a58d-c264831ee4a9" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:21:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:21:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:21:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:21:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:21:36 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:21:36 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7507MB free_disk=25.24483871459961GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 454e5897-0179-41fb-a58d-c264831ee4a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 62fc764f-1ca0-4916-ab0f-b822c9070c8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:21:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.646s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:37 user nova-compute[73121]: DEBUG nova.compute.manager [req-4bccc021-dc42-4518-9b30-115d88bfcea8 req-10c332a2-7f43-4792-bcb2-3ac9b27a6be7 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received event network-changed-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:37 user nova-compute[73121]: DEBUG nova.compute.manager [req-4bccc021-dc42-4518-9b30-115d88bfcea8 req-10c332a2-7f43-4792-bcb2-3ac9b27a6be7 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Refreshing instance network info cache due to event network-changed-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:21:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4bccc021-dc42-4518-9b30-115d88bfcea8 req-10c332a2-7f43-4792-bcb2-3ac9b27a6be7 service nova] Acquiring lock "refresh_cache-62fc764f-1ca0-4916-ab0f-b822c9070c8c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:21:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4bccc021-dc42-4518-9b30-115d88bfcea8 req-10c332a2-7f43-4792-bcb2-3ac9b27a6be7 service nova] Acquired lock "refresh_cache-62fc764f-1ca0-4916-ab0f-b822c9070c8c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:21:37 user nova-compute[73121]: DEBUG nova.network.neutron [req-4bccc021-dc42-4518-9b30-115d88bfcea8 req-10c332a2-7f43-4792-bcb2-3ac9b27a6be7 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Refreshing network info cache for port 3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'flavor' on Instance uuid 62fc764f-1ca0-4916-ab0f-b822c9070c8c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:21:38 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Ignoring supplied device name: /dev/vdb
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:38 user nova-compute[73121]: INFO nova.compute.manager [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Attaching volume 71b0d6cb-0efd-4c88-bd80-194ab900caa4 to /dev/vdb
Aug 15 02:21:38 user nova-compute[73121]: DEBUG nova.network.neutron [req-4bccc021-dc42-4518-9b30-115d88bfcea8 req-10c332a2-7f43-4792-bcb2-3ac9b27a6be7 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Updated VIF entry in instance network info cache for port 3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG nova.network.neutron [req-4bccc021-dc42-4518-9b30-115d88bfcea8 req-10c332a2-7f43-4792-bcb2-3ac9b27a6be7 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Updating instance_info_cache with network_info: [{"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4bccc021-dc42-4518-9b30-115d88bfcea8 req-10c332a2-7f43-4792-bcb2-3ac9b27a6be7 service nova] Releasing lock "refresh_cache-62fc764f-1ca0-4916-ab0f-b822c9070c8c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG os_brick.utils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f8a2f2-f651-43c6-98ef-b9e6746b64b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fa84e9-684d-42f2-99af-c6af9a3bac70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b55aeb0-8759-421e-8b49-9863a275c2c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[62daa1bf-9fb8-436f-9598-b1f7bb5bb508]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:21:38 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:21:38 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dab2cc4-4d92-4699-8fce-37b173f04c59]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG os_brick.utils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:21:38 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Updating existing volume attachment record: 3b1ad91e-1cdf-4905-958c-0e4eef04cd63 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:21:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:21:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-dcc2c79b-f037-41ba-bb82-736f40579fba req-1a2586ff-8e5d-4f01-99bd-15a7102ace02 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-dcc2c79b-f037-41ba-bb82-736f40579fba req-1a2586ff-8e5d-4f01-99bd-15a7102ace02 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing instance network info cache due to event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dcc2c79b-f037-41ba-bb82-736f40579fba req-1a2586ff-8e5d-4f01-99bd-15a7102ace02 service nova] Acquiring lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dcc2c79b-f037-41ba-bb82-736f40579fba req-1a2586ff-8e5d-4f01-99bd-15a7102ace02 service nova] Acquired lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-dcc2c79b-f037-41ba-bb82-736f40579fba req-1a2586ff-8e5d-4f01-99bd-15a7102ace02 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-dcc2c79b-f037-41ba-bb82-736f40579fba req-1a2586ff-8e5d-4f01-99bd-15a7102ace02 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updated VIF entry in instance network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-dcc2c79b-f037-41ba-bb82-736f40579fba req-1a2586ff-8e5d-4f01-99bd-15a7102ace02 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating instance_info_cache with network_info: [{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dcc2c79b-f037-41ba-bb82-736f40579fba req-1a2586ff-8e5d-4f01-99bd-15a7102ace02 service nova] Releasing lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-87355a31-5cfc-4c22-8b12-c37910555a52 req-cdfad611-b73b-46ae-b306-c7bae9de1122 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-87355a31-5cfc-4c22-8b12-c37910555a52 req-cdfad611-b73b-46ae-b306-c7bae9de1122 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing instance network info cache due to event network-changed-fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-87355a31-5cfc-4c22-8b12-c37910555a52 req-cdfad611-b73b-46ae-b306-c7bae9de1122 service nova] Acquiring lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-87355a31-5cfc-4c22-8b12-c37910555a52 req-cdfad611-b73b-46ae-b306-c7bae9de1122 service nova] Acquired lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:21:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-87355a31-5cfc-4c22-8b12-c37910555a52 req-cdfad611-b73b-46ae-b306-c7bae9de1122 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Refreshing network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:21:44 user nova-compute[73121]: INFO nova.compute.manager [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Detaching volume e68500c2-5ad3-4b14-b2cb-39c6cf8778a7
Aug 15 02:21:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:44 user nova-compute[73121]: INFO nova.virt.block_device [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Attempting to driver detach volume e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 from mountpoint /dev/vdb
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Attempting to detach device vdb from instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:21:44 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:21:44 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:21:44 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:21:44 user nova-compute[73121]:   <serial>e68500c2-5ad3-4b14-b2cb-39c6cf8778a7</serial>
Aug 15 02:21:44 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:21:44 user nova-compute[73121]: </disk>
Aug 15 02:21:44 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:21:44 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully detached device vdb from instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe from the persistent domain config.
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:21:44 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:21:44 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:21:44 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:21:44 user nova-compute[73121]:   <serial>e68500c2-5ad3-4b14-b2cb-39c6cf8778a7</serial>
Aug 15 02:21:44 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:21:44 user nova-compute[73121]: </disk>
Aug 15 02:21:44 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-87355a31-5cfc-4c22-8b12-c37910555a52 req-cdfad611-b73b-46ae-b306-c7bae9de1122 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updated VIF entry in instance network info cache for port fdec51f1-db71-4432-81de-2f4de0f7d3b2. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.network.neutron [req-87355a31-5cfc-4c22-8b12-c37910555a52 req-cdfad611-b73b-46ae-b306-c7bae9de1122 service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating instance_info_cache with network_info: [{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-87355a31-5cfc-4c22-8b12-c37910555a52 req-cdfad611-b73b-46ae-b306-c7bae9de1122 service nova] Releasing lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692066104.674569, 6fb561dc-705f-4bde-98a5-2076a9e1f8fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:21:44 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully detached device vdb from instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe from the live domain config.
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkDoqCgb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:21:44 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74541b9-faa9-46f2-a821-369cafe752d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[af639837-b317-40cc-ad4e-8cfff258645f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:21:44 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:21:44 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:21:44 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:21:44 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:21:44 user nova-compute[73121]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 (non-flash)
Aug 15 02:21:44 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:21:44 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:21:44 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc5477f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a9e4c4-94cc-4fa9-8bf0-9d0a19c49757]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c06d54-d2a9-4455-84bd-8ca7b4e3fc7e]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d287d6d-fc01-49a2-953c-201637f14202]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[592cf5dd-356b-49b6-96da-508b60fd27e0]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0990f4d7-4a56-4bc2-a5c4-7c7a691fc715]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0c972f-1544-4219-8b9b-ccdcd8377f95]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7, portal: 172.16.0.220,3260]
Aug 15 02:21:44 user nova-compute[73121]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7, portal: 172.16.0.220,3260] successful.
Aug 15 02:21:44 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e68500c2-5ad3-4b14-b2cb-39c6cf8778a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc5ae96-840b-4384-9838-24e15ca578dd]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] <== disconnect_volume: return (306ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:21:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:21:45 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'flavor' on Instance uuid 6fb561dc-705f-4bde-98a5-2076a9e1f8fe {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:21:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b16c1c82-0243-4593-a0ae-fa3e86ab2c14 tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.713s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuFEejyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:21:47 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:21:47 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:21:47 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08d3de0-1180-4cc6-aacd-98d77e372f5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:21:47 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9bfea9-b9c1-4afe-957e-dfc1ea392ed8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4] added
Aug 15 02:21:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8329e4a-2927-45dd-be47-5e751761888e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b75889-6a31-4a68-b738-8954f512f829]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuFEejyb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HuFEejyb" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dbd0ce-6f8d-45b1-8791-10b0a9752d3e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HuFEejyb'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f582e5-43e4-4db6-bee8-80bb37c0cbf8]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48a89c8-deb6-401c-b902-a9eca4bed1f4]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[315bffff-43ee-42fe-bf4e-c0dcb4d009cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4, portal: 172.16.0.220,3260]
Aug 15 02:21:47 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4, portal: 172.16.0.220,3260] successful.
Aug 15 02:21:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3fa2e9-4546-41d4-b962-a0c75b0f881c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39fee6f-6e1b-49a8-86f5-ccbac5550128]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)
Aug 15 02:21:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:21:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:21:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:21:48 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b350a45-8796-4f1e-b0d2-e831354d8938]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:21:48 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuFEejyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23837393032313434', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837393032313434', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'flavor' on Instance uuid 62fc764f-1ca0-4916-ab0f-b822c9070c8c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:21:49 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:21:49 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:21:49 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:21:49 user nova-compute[73121]:   <serial>71b0d6cb-0efd-4c88-bd80-194ab900caa4</serial>
Aug 15 02:21:49 user nova-compute[73121]: </disk>
Aug 15 02:21:49 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] No VIF found with MAC fa:16:3e:74:1a:00, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:21:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7cb400c1-ea7c-4a94-b0c4-dcde6819dc84 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.335s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:21:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-0240e576-5c60-4393-8cfa-3da6d6a6a1be req-89c30314-6371-4ef7-bb60-a8ec8a82c6c1 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received event network-changed-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:21:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-0240e576-5c60-4393-8cfa-3da6d6a6a1be req-89c30314-6371-4ef7-bb60-a8ec8a82c6c1 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Refreshing instance network info cache due to event network-changed-d971bce8-66de-4835-b772-b89e99985897. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:21:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0240e576-5c60-4393-8cfa-3da6d6a6a1be req-89c30314-6371-4ef7-bb60-a8ec8a82c6c1 service nova] Acquiring lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:21:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0240e576-5c60-4393-8cfa-3da6d6a6a1be req-89c30314-6371-4ef7-bb60-a8ec8a82c6c1 service nova] Acquired lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:21:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-0240e576-5c60-4393-8cfa-3da6d6a6a1be req-89c30314-6371-4ef7-bb60-a8ec8a82c6c1 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Refreshing network info cache for port d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:21:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-0240e576-5c60-4393-8cfa-3da6d6a6a1be req-89c30314-6371-4ef7-bb60-a8ec8a82c6c1 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updated VIF entry in instance network info cache for port d971bce8-66de-4835-b772-b89e99985897. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:21:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-0240e576-5c60-4393-8cfa-3da6d6a6a1be req-89c30314-6371-4ef7-bb60-a8ec8a82c6c1 service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updating instance_info_cache with network_info: [{"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:21:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0240e576-5c60-4393-8cfa-3da6d6a6a1be req-89c30314-6371-4ef7-bb60-a8ec8a82c6c1 service nova] Releasing lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:21:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:21:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "553dea46-d4d3-4362-816f-8c75a73cc65b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:22:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:22:02 user nova-compute[73121]: INFO nova.compute.claims [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Claim successful on node user
Aug 15 02:22:03 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG nova.network.neutron [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:22:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:22:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:22:03 user nova-compute[73121]: INFO nova.virt.block_device [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Booting with volume cc9bb027-06cd-41b0-abb7-9d0bb32deedf at /dev/vda
Aug 15 02:22:03 user nova-compute[73121]: DEBUG nova.policy [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f9c4f2ffebb440cb88132a502d51811', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e3397dd14ca44c19dc4386aec30a9a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG os_brick.utils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb282938-62ce-44d8-b81c-9086d787c09a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e8f3f1-7128-4ede-a7b0-3450732cfe7b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bb36d4-4601-4f3a-b4c7-40d84b93b7c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9825ed5e-0008-4c0d-aa7b-a017a38eff6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:22:03 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:22:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f165ff9e-8ec7-4d15-81e1-2c8ff45f05b4]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG os_brick.utils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:22:03 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updating existing volume attachment record: 4e5aaccb-87a7-4ff6-b8c8-af1f534de83c {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:22:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:04 user nova-compute[73121]: DEBUG nova.network.neutron [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Successfully created port: 8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:22:04 user nova-compute[73121]: DEBUG nova.network.neutron [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Successfully updated port: 8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:22:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:22:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquired lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:22:04 user nova-compute[73121]: DEBUG nova.network.neutron [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-586c2863-1caf-4c13-867d-575a4eada77b req-990e0ba6-4c9c-4645-8f8a-d7176d9a0a5b service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received event network-changed-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-586c2863-1caf-4c13-867d-575a4eada77b req-990e0ba6-4c9c-4645-8f8a-d7176d9a0a5b service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Refreshing instance network info cache due to event network-changed-8983c92e-c4f6-4b11-82a2-accd478d9070. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-586c2863-1caf-4c13-867d-575a4eada77b req-990e0ba6-4c9c-4645-8f8a-d7176d9a0a5b service nova] Acquiring lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG nova.network.neutron [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG nova.network.neutron [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updating instance_info_cache with network_info: [{"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Releasing lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Instance network_info: |[{"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-586c2863-1caf-4c13-867d-575a4eada77b req-990e0ba6-4c9c-4645-8f8a-d7176d9a0a5b service nova] Acquired lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG nova.network.neutron [req-586c2863-1caf-4c13-867d-575a4eada77b req-990e0ba6-4c9c-4645-8f8a-d7176d9a0a5b service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Refreshing network info cache for port 8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG nova.network.neutron [req-586c2863-1caf-4c13-867d-575a4eada77b req-990e0ba6-4c9c-4645-8f8a-d7176d9a0a5b service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updated VIF entry in instance network info cache for port 8983c92e-c4f6-4b11-82a2-accd478d9070. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG nova.network.neutron [req-586c2863-1caf-4c13-867d-575a4eada77b req-990e0ba6-4c9c-4645-8f8a-d7176d9a0a5b service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updating instance_info_cache with network_info: [{"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:22:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-586c2863-1caf-4c13-867d-575a4eada77b req-990e0ba6-4c9c-4645-8f8a-d7176d9a0a5b service nova] Releasing lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:22:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:22:13 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Creating image(s)
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Ensure instance console log exists: /opt/stack/data/nova/instances/553dea46-d4d3-4362-816f-8c75a73cc65b/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Start _get_guest_xml network_info=[{"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '4e5aaccb-87a7-4ff6-b8c8-af1f534de83c', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyMWTVkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '553dea46-d4d3-4362-816f-8c75a73cc65b', 'attached_at': '', 'detached_at': '', 'volume_id': 'cc9bb027-06cd-41b0-abb7-9d0bb32deedf', 'serial': 'cc9bb027-06cd-41b0-abb7-9d0bb32deedf'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:22:13 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:22:13 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyMWTVkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:22:13 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:22:13 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:22:13 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb3268d-8aff-4898-aec7-77affaeb7334]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:22:13 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[58403938-30f8-4cbe-91fb-028da2a8138b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf] added
Aug 15 02:22:13 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c279a2c5-8281-4dd7-a802-21dda7718faa]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e43757c-ff3c-40b5-ae73-add00d979d14]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RyMWTVkU {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RyMWTVkU" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d904de8-d5ee-457a-9748-5e3775079e92]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RyMWTVkU'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0c6c40-f451-43ba-9939-ea14490830da]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f4cb4-f3b9-4d77-9d74-14bcc2a24c23]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8788a131-d3cc-4e59-836d-ef27d01107eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf, portal: 172.16.0.220,3260]
Aug 15 02:22:13 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf, portal: 172.16.0.220,3260] successful.
Aug 15 02:22:13 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc103f4c-fcb7-4afd-b2bd-e5d50161a1a7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[190e179e-9dd9-4689-b2ba-daa9084c2180]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:22:13 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)
Aug 15 02:22:13 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:22:13 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] HCTL ('37', '-', '-', 0) found on session 54 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc026bfc-00b9-4261-a564-9720a175e21c]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:13 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching for a device in session 54 and hctl ['37', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Searching for a device in session 54 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyMWTVkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23138356435313061', 'path': '/dev/sdf'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138356435313061', 'path': '/dev/sdf'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1618481789',display_name='tempest-TestVolumeBootPattern-server-1618481789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1618481789',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuKaje8XOyRteWQDYhsHPlBp1Xjeq99eSrwstRwpVv8kz+qsXnyj4MM3934HkKDRT/PtguSeoZK5bF8tR96SJXazwgYAgV+WiBSzEqWb7KFKLbBhYz1ys01ett7El1jYw==',key_name='tempest-TestVolumeBootPattern-929875393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-ipwna84t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:22:04Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=553dea46-d4d3-4362-816f-8c75a73cc65b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a6:b8,bridge_name='br-int',has_traffic_filtering=True,id=8983c92e-c4f6-4b11-82a2-accd478d9070,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8983c92e-c4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.objects.instance [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'pci_devices' on Instance uuid 553dea46-d4d3-4362-816f-8c75a73cc65b {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:22:14 user nova-compute[73121]:   <uuid>553dea46-d4d3-4362-816f-8c75a73cc65b</uuid>
Aug 15 02:22:14 user nova-compute[73121]:   <name>instance-0000002c</name>
Aug 15 02:22:14 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:22:14 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:22:14 user nova-compute[73121]:   <metadata>
Aug 15 02:22:14 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:22:14 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:22:14 user nova-compute[73121]:       <nova:name>tempest-TestVolumeBootPattern-server-1618481789</nova:name>
Aug 15 02:22:14 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:22:13</nova:creationTime>
Aug 15 02:22:14 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:22:14 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:22:14 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:22:14 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:22:14 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:22:14 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:22:14 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:22:14 user nova-compute[73121]:       <nova:owner>
Aug 15 02:22:14 user nova-compute[73121]:         <nova:user uuid="9f9c4f2ffebb440cb88132a502d51811">tempest-TestVolumeBootPattern-151395753-project-member</nova:user>
Aug 15 02:22:14 user nova-compute[73121]:         <nova:project uuid="2e3397dd14ca44c19dc4386aec30a9a4">tempest-TestVolumeBootPattern-151395753</nova:project>
Aug 15 02:22:14 user nova-compute[73121]:       </nova:owner>
Aug 15 02:22:14 user nova-compute[73121]:       <nova:ports>
Aug 15 02:22:14 user nova-compute[73121]:         <nova:port uuid="8983c92e-c4f6-4b11-82a2-accd478d9070">
Aug 15 02:22:14 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 02:22:14 user nova-compute[73121]:         </nova:port>
Aug 15 02:22:14 user nova-compute[73121]:       </nova:ports>
Aug 15 02:22:14 user nova-compute[73121]:     </nova:instance>
Aug 15 02:22:14 user nova-compute[73121]:   </metadata>
Aug 15 02:22:14 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:22:14 user nova-compute[73121]:     <system>
Aug 15 02:22:14 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:22:14 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:22:14 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:22:14 user nova-compute[73121]:       <entry name="serial">553dea46-d4d3-4362-816f-8c75a73cc65b</entry>
Aug 15 02:22:14 user nova-compute[73121]:       <entry name="uuid">553dea46-d4d3-4362-816f-8c75a73cc65b</entry>
Aug 15 02:22:14 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:22:14 user nova-compute[73121]:     </system>
Aug 15 02:22:14 user nova-compute[73121]:   </sysinfo>
Aug 15 02:22:14 user nova-compute[73121]:   <os>
Aug 15 02:22:14 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:22:14 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:22:14 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:22:14 user nova-compute[73121]:   </os>
Aug 15 02:22:14 user nova-compute[73121]:   <features>
Aug 15 02:22:14 user nova-compute[73121]:     <acpi/>
Aug 15 02:22:14 user nova-compute[73121]:     <apic/>
Aug 15 02:22:14 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:22:14 user nova-compute[73121]:   </features>
Aug 15 02:22:14 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:22:14 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:22:14 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:22:14 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:22:14 user nova-compute[73121]:   </clock>
Aug 15 02:22:14 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:22:14 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:22:14 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:22:14 user nova-compute[73121]:   </cpu>
Aug 15 02:22:14 user nova-compute[73121]:   <devices>
Aug 15 02:22:14 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:22:14 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:22:14 user nova-compute[73121]:       <source dev="/dev/sdf"/>
Aug 15 02:22:14 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:22:14 user nova-compute[73121]:       <serial>cc9bb027-06cd-41b0-abb7-9d0bb32deedf</serial>
Aug 15 02:22:14 user nova-compute[73121]:     </disk>
Aug 15 02:22:14 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:22:14 user nova-compute[73121]:       <mac address="fa:16:3e:b3:a6:b8"/>
Aug 15 02:22:14 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:22:14 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:22:14 user nova-compute[73121]:       <target dev="tap8983c92e-c4"/>
Aug 15 02:22:14 user nova-compute[73121]:     </interface>
Aug 15 02:22:14 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:22:14 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/553dea46-d4d3-4362-816f-8c75a73cc65b/console.log" append="off"/>
Aug 15 02:22:14 user nova-compute[73121]:     </serial>
Aug 15 02:22:14 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:22:14 user nova-compute[73121]:     <video>
Aug 15 02:22:14 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:22:14 user nova-compute[73121]:     </video>
Aug 15 02:22:14 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:22:14 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:22:14 user nova-compute[73121]:     </rng>
Aug 15 02:22:14 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:22:14 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:22:14 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:22:14 user nova-compute[73121]:     </memballoon>
Aug 15 02:22:14 user nova-compute[73121]:   </devices>
Aug 15 02:22:14 user nova-compute[73121]: </domain>
Aug 15 02:22:14 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1618481789',display_name='tempest-TestVolumeBootPattern-server-1618481789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1618481789',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuKaje8XOyRteWQDYhsHPlBp1Xjeq99eSrwstRwpVv8kz+qsXnyj4MM3934HkKDRT/PtguSeoZK5bF8tR96SJXazwgYAgV+WiBSzEqWb7KFKLbBhYz1ys01ett7El1jYw==',key_name='tempest-TestVolumeBootPattern-929875393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-ipwna84t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:22:04Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=553dea46-d4d3-4362-816f-8c75a73cc65b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a6:b8,bridge_name='br-int',has_traffic_filtering=True,id=8983c92e-c4f6-4b11-82a2-accd478d9070,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8983c92e-c4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG os_vif [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a6:b8,bridge_name='br-int',has_traffic_filtering=True,id=8983c92e-c4f6-4b11-82a2-accd478d9070,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8983c92e-c4') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8983c92e-c4, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8983c92e-c4, col_values=(('external_ids', {'iface-id': '8983c92e-c4f6-4b11-82a2-accd478d9070', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:a6:b8', 'vm-uuid': '553dea46-d4d3-4362-816f-8c75a73cc65b'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:14 user nova-compute[73121]: INFO os_vif [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:a6:b8,bridge_name='br-int',has_traffic_filtering=True,id=8983c92e-c4f6-4b11-82a2-accd478d9070,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8983c92e-c4')
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:22:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] No VIF found with MAC fa:16:3e:b3:a6:b8, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:22:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-e752612e-7146-4988-b3a7-c835ef4e2421 req-5eaf6413-62b9-4e38-83bb-69b803ecc278 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received event network-vif-plugged-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e752612e-7146-4988-b3a7-c835ef4e2421 req-5eaf6413-62b9-4e38-83bb-69b803ecc278 service nova] Acquiring lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e752612e-7146-4988-b3a7-c835ef4e2421 req-5eaf6413-62b9-4e38-83bb-69b803ecc278 service nova] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e752612e-7146-4988-b3a7-c835ef4e2421 req-5eaf6413-62b9-4e38-83bb-69b803ecc278 service nova] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:16 user nova-compute[73121]: DEBUG nova.compute.manager [req-e752612e-7146-4988-b3a7-c835ef4e2421 req-5eaf6413-62b9-4e38-83bb-69b803ecc278 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] No waiting events found dispatching network-vif-plugged-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:22:16 user nova-compute[73121]: WARNING nova.compute.manager [req-e752612e-7146-4988-b3a7-c835ef4e2421 req-5eaf6413-62b9-4e38-83bb-69b803ecc278 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received unexpected event network-vif-plugged-8983c92e-c4f6-4b11-82a2-accd478d9070 for instance with vm_state building and task_state spawning.
Aug 15 02:22:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066138.1700628, 553dea46-d4d3-4362-816f-8c75a73cc65b => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:22:18 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] VM Resumed (Lifecycle Event)
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:22:18 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Instance spawned successfully.
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:22:18 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066138.1719701, 553dea46-d4d3-4362-816f-8c75a73cc65b => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:22:18 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] VM Started (Lifecycle Event)
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:22:18 user nova-compute[73121]: INFO nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:22:18 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-62af0262-f2d2-4e64-b77a-373112ae10f0 req-2853e2fc-411f-4fc4-9164-3b2f6d1007cf service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received event network-vif-plugged-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-62af0262-f2d2-4e64-b77a-373112ae10f0 req-2853e2fc-411f-4fc4-9164-3b2f6d1007cf service nova] Acquiring lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-62af0262-f2d2-4e64-b77a-373112ae10f0 req-2853e2fc-411f-4fc4-9164-3b2f6d1007cf service nova] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-62af0262-f2d2-4e64-b77a-373112ae10f0 req-2853e2fc-411f-4fc4-9164-3b2f6d1007cf service nova] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:18 user nova-compute[73121]: DEBUG nova.compute.manager [req-62af0262-f2d2-4e64-b77a-373112ae10f0 req-2853e2fc-411f-4fc4-9164-3b2f6d1007cf service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] No waiting events found dispatching network-vif-plugged-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:22:18 user nova-compute[73121]: WARNING nova.compute.manager [req-62af0262-f2d2-4e64-b77a-373112ae10f0 req-2853e2fc-411f-4fc4-9164-3b2f6d1007cf service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received unexpected event network-vif-plugged-8983c92e-c4f6-4b11-82a2-accd478d9070 for instance with vm_state building and task_state spawning.
Aug 15 02:22:18 user nova-compute[73121]: INFO nova.compute.manager [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Took 15.43 seconds to build instance.
Aug 15 02:22:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-cd622282-2ca7-4bd1-87f7-8c072073cf49 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.545s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:21 user nova-compute[73121]: INFO nova.compute.manager [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Detaching volume 71b0d6cb-0efd-4c88-bd80-194ab900caa4
Aug 15 02:22:21 user nova-compute[73121]: INFO nova.virt.block_device [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Attempting to driver detach volume 71b0d6cb-0efd-4c88-bd80-194ab900caa4 from mountpoint /dev/vdb
Aug 15 02:22:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Attempting to detach device vdb from instance 62fc764f-1ca0-4916-ab0f-b822c9070c8c from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:22:21 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:22:21 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:22:21 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:22:21 user nova-compute[73121]:   <serial>71b0d6cb-0efd-4c88-bd80-194ab900caa4</serial>
Aug 15 02:22:21 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:22:21 user nova-compute[73121]: </disk>
Aug 15 02:22:21 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:22:21 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Successfully detached device vdb from instance 62fc764f-1ca0-4916-ab0f-b822c9070c8c from the persistent domain config.
Aug 15 02:22:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62fc764f-1ca0-4916-ab0f-b822c9070c8c from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:22:21 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:22:21 user nova-compute[73121]:   <source dev="/dev/sdc"/>
Aug 15 02:22:21 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:22:21 user nova-compute[73121]:   <serial>71b0d6cb-0efd-4c88-bd80-194ab900caa4</serial>
Aug 15 02:22:21 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:22:21 user nova-compute[73121]: </disk>
Aug 15 02:22:21 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692066141.929917, 62fc764f-1ca0-4916-ab0f-b822c9070c8c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62fc764f-1ca0-4916-ab0f-b822c9070c8c {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:22:21 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Successfully detached device vdb from instance 62fc764f-1ca0-4916-ab0f-b822c9070c8c from the live domain config.
Aug 15 02:22:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuFEejyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:22:21 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:22:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9f296c-2a65-4610-8b1f-eb383ea59aa6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb1f26a-d5e9-4cf1-bae1-5955dbcd1813]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:22 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:22 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:22:22 user nova-compute[73121]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)
Aug 15 02:22:22 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:22:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:22 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:22 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:22:22 user nova-compute[73121]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 (non-flash)
Aug 15 02:22:22 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:22:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e205d5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[12024556-ff38-47c7-b017-384c23b35c03]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe7b937-bb9c-42d3-9c39-9deffeae2d89]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c34268b-fe36-48ea-bcbd-54a461d997f2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b47f45-6fcb-4887-9c8e-f5b6d2761b88]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c892163-a3a4-48ac-82c6-015878e2b077]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46e1287-fba6-4ae5-a304-bcd4981a362f]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4, portal: 172.16.0.220,3260]
Aug 15 02:22:22 user nova-compute[73121]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4, portal: 172.16.0.220,3260] successful.
Aug 15 02:22:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f44f5c4-fc3a-4b31-8780-dfd836043a7f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] <== disconnect_volume: return (317ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:22:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:23 user nova-compute[73121]: INFO nova.compute.manager [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Detaching volume 1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'flavor' on Instance uuid 62fc764f-1ca0-4916-ab0f-b822c9070c8c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-902f0cc0-de1a-4b38-9010-1c6eaab566f8 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.810s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.669s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:23 user nova-compute[73121]: INFO nova.compute.manager [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Terminating instance
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:22:23 user nova-compute[73121]: INFO nova.virt.block_device [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Attempting to driver detach volume 1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 from mountpoint /dev/vdc
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Attempting to detach device vdc from instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:22:23 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:22:23 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:22:23 user nova-compute[73121]:   <target dev="vdc" bus="virtio"/>
Aug 15 02:22:23 user nova-compute[73121]:   <serial>1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2</serial>
Aug 15 02:22:23 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 02:22:23 user nova-compute[73121]: </disk>
Aug 15 02:22:23 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:22:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully detached device vdc from instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 from the persistent domain config.
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:22:23 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:22:23 user nova-compute[73121]:   <source dev="/dev/sde"/>
Aug 15 02:22:23 user nova-compute[73121]:   <target dev="vdc" bus="virtio"/>
Aug 15 02:22:23 user nova-compute[73121]:   <serial>1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2</serial>
Aug 15 02:22:23 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 02:22:23 user nova-compute[73121]: </disk>
Aug 15 02:22:23 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-88f8335e-6604-4a11-ac89-e78e42ab812e req-baf6af15-f006-4310-84ff-27bef783fcd5 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received event network-vif-unplugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-88f8335e-6604-4a11-ac89-e78e42ab812e req-baf6af15-f006-4310-84ff-27bef783fcd5 service nova] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-88f8335e-6604-4a11-ac89-e78e42ab812e req-baf6af15-f006-4310-84ff-27bef783fcd5 service nova] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-88f8335e-6604-4a11-ac89-e78e42ab812e req-baf6af15-f006-4310-84ff-27bef783fcd5 service nova] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-88f8335e-6604-4a11-ac89-e78e42ab812e req-baf6af15-f006-4310-84ff-27bef783fcd5 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] No waiting events found dispatching network-vif-unplugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-88f8335e-6604-4a11-ac89-e78e42ab812e req-baf6af15-f006-4310-84ff-27bef783fcd5 service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received event network-vif-unplugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692066143.7346709, 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:22:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully detached device vdc from instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 from the live domain config.
Aug 15 02:22:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avFCpunz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:22:23 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b338f14-e834-4be1-8d82-62edf3604bcf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dae035-2e2d-4d80-92be-668ab9447011]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:23 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:23 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:22:23 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:22:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:23 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:23 user nova-compute[73121]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 (non-flash)
Aug 15 02:22:23 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:22:23 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e32767ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2'): ({'sde'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Removing single pathed devices sde {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[093a1e26-6457-48c8-bc46-1cbf231b8d5b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa899dec-6ed2-4541-bcde-d121e6b0a5c6]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Flushing IO for device /dev/sde {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e73a180-cc3e-4eaa-8cf1-2cd2047471e9]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[53614198-cd20-4090-b9ba-e173821362ac]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] SCSI volumes sde have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:22:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e45f2c8-b1f3-479f-97db-f6f466a78354]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e36d33-5da1-4de2-91ac-a8cc923bcbf4]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2, portal: 172.16.0.220,3260]
Aug 15 02:22:24 user nova-compute[73121]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2, portal: 172.16.0.220,3260] successful.
Aug 15 02:22:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c4124e6-4e62-409a-b2d4-7d5e5bf47ab2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fe21ad-945b-4e65-abc5-eb26a1a3e8af]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] <== disconnect_volume: return (356ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:22:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Instance destroyed successfully.
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lazy-loading 'resources' on Instance uuid 62fc764f-1ca0-4916-ab0f-b822c9070c8c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:19:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1263102305',display_name='tempest-VolumesSnapshotTestJSON-instance-1263102305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1263102305',id=40,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBbJhzu5lwB3NYHKk6+oLOW4ftT6XcQ7F2hVPeU3KpP6Efnr9jqAM1nSeDijWSYn7FDu9WlySZv30FotIRHoz8aFMD0dIJIsNbHe71CRK61gAJZSQpK3Tytxwmrzp7SM+A==',key_name='tempest-keypair-1795842592',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:19:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7093d5ade03430488a4713acba49588',ramdisk_id='',reservation_id='r-uhgyh6sv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1030319394',owner_user_name='tempest-VolumesSnapshotTestJSON-1030319394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f199d32620e4c0d9d48b9737d2f8f23',uuid=62fc764f-1ca0-4916-ab0f-b822c9070c8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converting VIF {"id": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "address": "fa:16:3e:74:1a:00", "network": {"id": "b2d1a4a3-6d67-4e89-b777-90102270fde5", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1340256953-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7093d5ade03430488a4713acba49588", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b9d2dc5-74", "ovs_interfaceid": "3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:1a:00,bridge_name='br-int',has_traffic_filtering=True,id=3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9d2dc5-74') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_vif [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:1a:00,bridge_name='br-int',has_traffic_filtering=True,id=3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9d2dc5-74') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b9d2dc5-74, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:22:24 user nova-compute[73121]: INFO os_vif [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:1a:00,bridge_name='br-int',has_traffic_filtering=True,id=3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a,network=Network(b2d1a4a3-6d67-4e89-b777-90102270fde5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b9d2dc5-74')
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HuFEejyb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:22:24 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71b0d6cb-0efd-4c88-bd80-194ab900caa4', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c191d4-d135-4f06-945f-749457c8b3a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb29dee-c657-40ac-827c-b054e7e21392]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:24 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:24 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:22:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:22:24 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:22:24 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:22:24 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc789b40>, {}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Disconnecting from: [] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] <== disconnect_volume: return (51ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:22:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Deleting instance files /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c_del
Aug 15 02:22:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Deletion of /opt/stack/data/nova/instances/62fc764f-1ca0-4916-ab0f-b822c9070c8c_del complete
Aug 15 02:22:24 user nova-compute[73121]: INFO nova.compute.manager [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'flavor' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1bc2a553-40b3-4ca4-b728-678701a8df6c tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.877s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:25 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:22:25 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Took 1.29 seconds to deallocate network for instance.
Aug 15 02:22:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-29fe4de4-c0b2-4f0d-ad35-49528c73c5c6 req-c508863c-2de1-4880-b16d-b801a180dd1c service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received event network-vif-plugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-29fe4de4-c0b2-4f0d-ad35-49528c73c5c6 req-c508863c-2de1-4880-b16d-b801a180dd1c service nova] Acquiring lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-29fe4de4-c0b2-4f0d-ad35-49528c73c5c6 req-c508863c-2de1-4880-b16d-b801a180dd1c service nova] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-29fe4de4-c0b2-4f0d-ad35-49528c73c5c6 req-c508863c-2de1-4880-b16d-b801a180dd1c service nova] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-29fe4de4-c0b2-4f0d-ad35-49528c73c5c6 req-c508863c-2de1-4880-b16d-b801a180dd1c service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] No waiting events found dispatching network-vif-plugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:22:25 user nova-compute[73121]: WARNING nova.compute.manager [req-29fe4de4-c0b2-4f0d-ad35-49528c73c5c6 req-c508863c-2de1-4880-b16d-b801a180dd1c service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received unexpected event network-vif-plugged-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a for instance with vm_state active and task_state deleting.
Aug 15 02:22:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-d2dde5cf-a081-4bd2-8298-08c317aa2e6f req-0c87e250-1fc4-4051-ab45-a1874f0f101d service nova] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Received event network-vif-deleted-3b9d2dc5-7415-4e3f-bbb4-756a4ba79c4a {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:25 user nova-compute[73121]: WARNING nova.volume.cinder [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Attachment 3b1ad91e-1cdf-4905-958c-0e4eef04cd63 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3b1ad91e-1cdf-4905-958c-0e4eef04cd63. (HTTP 404) (Request-ID: req-718caa5a-d20a-4063-b698-edcc12ee971f)
Aug 15 02:22:25 user nova-compute[73121]: INFO nova.compute.manager [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 02:22:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:25 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:22:25 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:22:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:26 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Deleted allocations for instance 62fc764f-1ca0-4916-ab0f-b822c9070c8c
Aug 15 02:22:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e11d9369-0c26-455c-a135-179e656a43f5 tempest-VolumesSnapshotTestJSON-1030319394 tempest-VolumesSnapshotTestJSON-1030319394-project-member] Lock "62fc764f-1ca0-4916-ab0f-b822c9070c8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.931s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:28 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:22:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:30 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating instance_info_cache with network_info: [{"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-6fb561dc-705f-4bde-98a5-2076a9e1f8fe" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:33 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:22:36 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:22:36 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7635MB free_disk=25.265365600585938GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 454e5897-0179-41fb-a58d-c264831ee4a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 553dea46-d4d3-4362-816f-8c75a73cc65b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:22:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:39 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066144.142983, 62fc764f-1ca0-4916-ab0f-b822c9070c8c => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:22:39 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] VM Stopped (Lifecycle Event)
Aug 15 02:22:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d80f8dca-30ee-4e0a-a1ca-772e96687fcf None None] [instance: 62fc764f-1ca0-4916-ab0f-b822c9070c8c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:22:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:40 user nova-compute[73121]: INFO nova.compute.manager [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Terminating instance
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-6eb064ad-1de1-4f69-9903-39d538d43c20 req-75be7c9c-96b4-475f-8c5a-d4c24c356f7b service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-unplugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6eb064ad-1de1-4f69-9903-39d538d43c20 req-75be7c9c-96b4-475f-8c5a-d4c24c356f7b service nova] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6eb064ad-1de1-4f69-9903-39d538d43c20 req-75be7c9c-96b4-475f-8c5a-d4c24c356f7b service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6eb064ad-1de1-4f69-9903-39d538d43c20 req-75be7c9c-96b4-475f-8c5a-d4c24c356f7b service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-6eb064ad-1de1-4f69-9903-39d538d43c20 req-75be7c9c-96b4-475f-8c5a-d4c24c356f7b service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] No waiting events found dispatching network-vif-unplugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-6eb064ad-1de1-4f69-9903-39d538d43c20 req-75be7c9c-96b4-475f-8c5a-d4c24c356f7b service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-unplugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:22:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Instance destroyed successfully.
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.objects.instance [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lazy-loading 'resources' on Instance uuid 6fb561dc-705f-4bde-98a5-2076a9e1f8fe {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2146820867',display_name='tempest-TestMinimumBasicScenario-server-2146820867',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2146820867',id=39,image_ref='4cb2e30e-ef2d-46cd-a433-71c9a278c4c0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDk5uMeIlAl6UKfNNSXNpk4cf5/qITn9En3eHzRRlGTvambTXNQDC5DPhcMh9oQMfcuWQEsZCd/GpymQ+EwBw7c8rY8rahLjkPSllvGMOppi61fWgj7UBNdDwXeBNf65w==',key_name='tempest-TestMinimumBasicScenario-1339006850',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:17:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b1b3c8eef30d43d98388840e389efc24',ramdisk_id='',reservation_id='r-3qmp9mn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4cb2e30e-ef2d-46cd-a433-71c9a278c4c0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2011934660',owner_user_name='tempest-TestMinimumBasicScenario-2011934660-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:20:00Z,user_data=None,user_id='3992e0609efb4ad389253810ab9b0d33',uuid=6fb561dc-705f-4bde-98a5-2076a9e1f8fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converting VIF {"id": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "address": "fa:16:3e:9f:fa:55", "network": {"id": "d04dbd22-8aa1-4771-bed4-78d19bee6812", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-236373962-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b1b3c8eef30d43d98388840e389efc24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdec51f1-db", "ovs_interfaceid": "fdec51f1-db71-4432-81de-2f4de0f7d3b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:fa:55,bridge_name='br-int',has_traffic_filtering=True,id=fdec51f1-db71-4432-81de-2f4de0f7d3b2,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdec51f1-db') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG os_vif [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:fa:55,bridge_name='br-int',has_traffic_filtering=True,id=fdec51f1-db71-4432-81de-2f4de0f7d3b2,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdec51f1-db') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdec51f1-db, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:22:40 user nova-compute[73121]: INFO os_vif [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:fa:55,bridge_name='br-int',has_traffic_filtering=True,id=fdec51f1-db71-4432-81de-2f4de0f7d3b2,network=Network(d04dbd22-8aa1-4771-bed4-78d19bee6812),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdec51f1-db')
Aug 15 02:22:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Deleting instance files /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe_del
Aug 15 02:22:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Deletion of /opt/stack/data/nova/instances/6fb561dc-705f-4bde-98a5-2076a9e1f8fe_del complete
Aug 15 02:22:40 user nova-compute[73121]: INFO nova.compute.manager [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 02:22:40 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:22:40 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:22:41 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:22:41 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Took 0.65 seconds to deallocate network for instance.
Aug 15 02:22:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-b6a366a6-5084-4c1f-9fc9-23a95390635f req-e565fd5a-850c-411c-9924-b1450e094dfc service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-deleted-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:41 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:22:41 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:22:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:42 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Deleted allocations for instance 6fb561dc-705f-4bde-98a5-2076a9e1f8fe
Aug 15 02:22:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-48c1c224-1961-4829-b2ab-462cd28fc53d tempest-TestMinimumBasicScenario-2011934660 tempest-TestMinimumBasicScenario-2011934660-project-member] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.031s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-b6000ec1-8085-434c-9193-ed9118621332 req-83806119-6258-4d89-879f-70fe5000b8ea service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b6000ec1-8085-434c-9193-ed9118621332 req-83806119-6258-4d89-879f-70fe5000b8ea service nova] Acquiring lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b6000ec1-8085-434c-9193-ed9118621332 req-83806119-6258-4d89-879f-70fe5000b8ea service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-b6000ec1-8085-434c-9193-ed9118621332 req-83806119-6258-4d89-879f-70fe5000b8ea service nova] Lock "6fb561dc-705f-4bde-98a5-2076a9e1f8fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-b6000ec1-8085-434c-9193-ed9118621332 req-83806119-6258-4d89-879f-70fe5000b8ea service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] No waiting events found dispatching network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:22:42 user nova-compute[73121]: WARNING nova.compute.manager [req-b6000ec1-8085-434c-9193-ed9118621332 req-83806119-6258-4d89-879f-70fe5000b8ea service nova] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Received unexpected event network-vif-plugged-fdec51f1-db71-4432-81de-2f4de0f7d3b2 for instance with vm_state deleted and task_state None.
Aug 15 02:22:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:44 user nova-compute[73121]: INFO nova.compute.manager [None req-2b0b6271-d503-4d8b-be7d-3d3bff388ceb tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Get console output
Aug 15 02:22:44 user nova-compute[73121]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 15 02:22:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:54 user nova-compute[73121]: INFO nova.compute.manager [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Rescuing
Aug 15 02:22:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:22:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquired lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:22:54 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:22:55 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updating instance_info_cache with network_info: [{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:22:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Releasing lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:22:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:55 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066160.8593993, 6fb561dc-705f-4bde-98a5-2076a9e1f8fe => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:22:55 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] VM Stopped (Lifecycle Event)
Aug 15 02:22:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-37b4bc51-f407-49ba-adc2-506a9714b687 None None] [instance: 6fb561dc-705f-4bde-98a5-2076a9e1f8fe] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:22:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:56 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Instance destroyed successfully.
Aug 15 02:22:56 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Attempting rescue
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73121) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Instance directory exists: not creating {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 02:22:56 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Creating image(s)
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'trusted_certs' on Instance uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue" returned: 0 in 0.057s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'migration_context' on Instance uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Start _get_guest_xml network_info=[{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "vif_mac": "fa:16:3e:70:dc:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'resources' on Instance uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'numa_topology' on Instance uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:22:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-841237313',display_name='tempest-ServerRescueNegativeTestJSON-server-841237313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-841237313',id=43,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:21:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-t8g0dkoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:21:13Z,user_data=None,user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=22339f3c-9ef1-4630-94c2-a56f0b97aba6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "vif_mac": "fa:16:3e:70:dc:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "vif_mac": "fa:16:3e:70:dc:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:dc:15,bridge_name='br-int',has_traffic_filtering=True,id=d0508681-b710-480c-9533-73fdf1cb3d7d,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0508681-b7') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'pci_devices' on Instance uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:22:56 user nova-compute[73121]:   <uuid>22339f3c-9ef1-4630-94c2-a56f0b97aba6</uuid>
Aug 15 02:22:56 user nova-compute[73121]:   <name>instance-0000002b</name>
Aug 15 02:22:56 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:22:56 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:22:56 user nova-compute[73121]:   <metadata>
Aug 15 02:22:56 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:22:56 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:22:56 user nova-compute[73121]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-841237313</nova:name>
Aug 15 02:22:56 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:22:56</nova:creationTime>
Aug 15 02:22:56 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:22:56 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:22:56 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:22:56 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:22:56 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:22:56 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:22:56 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:22:56 user nova-compute[73121]:       <nova:owner>
Aug 15 02:22:56 user nova-compute[73121]:         <nova:user uuid="c5012859ad374ac0b441cc5a5739cf4e">tempest-ServerRescueNegativeTestJSON-704093322-project-member</nova:user>
Aug 15 02:22:56 user nova-compute[73121]:         <nova:project uuid="c202114f5c584284a72d52cececc4b34">tempest-ServerRescueNegativeTestJSON-704093322</nova:project>
Aug 15 02:22:56 user nova-compute[73121]:       </nova:owner>
Aug 15 02:22:56 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:22:56 user nova-compute[73121]:       <nova:ports>
Aug 15 02:22:56 user nova-compute[73121]:         <nova:port uuid="d0508681-b710-480c-9533-73fdf1cb3d7d">
Aug 15 02:22:56 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 02:22:56 user nova-compute[73121]:         </nova:port>
Aug 15 02:22:56 user nova-compute[73121]:       </nova:ports>
Aug 15 02:22:56 user nova-compute[73121]:     </nova:instance>
Aug 15 02:22:56 user nova-compute[73121]:   </metadata>
Aug 15 02:22:56 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:22:56 user nova-compute[73121]:     <system>
Aug 15 02:22:56 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:22:56 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:22:56 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:22:56 user nova-compute[73121]:       <entry name="serial">22339f3c-9ef1-4630-94c2-a56f0b97aba6</entry>
Aug 15 02:22:56 user nova-compute[73121]:       <entry name="uuid">22339f3c-9ef1-4630-94c2-a56f0b97aba6</entry>
Aug 15 02:22:56 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:22:56 user nova-compute[73121]:     </system>
Aug 15 02:22:56 user nova-compute[73121]:   </sysinfo>
Aug 15 02:22:56 user nova-compute[73121]:   <os>
Aug 15 02:22:56 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:22:56 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:22:56 user nova-compute[73121]:   </os>
Aug 15 02:22:56 user nova-compute[73121]:   <features>
Aug 15 02:22:56 user nova-compute[73121]:     <acpi/>
Aug 15 02:22:56 user nova-compute[73121]:     <apic/>
Aug 15 02:22:56 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:22:56 user nova-compute[73121]:   </features>
Aug 15 02:22:56 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:22:56 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:22:56 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:22:56 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:22:56 user nova-compute[73121]:   </clock>
Aug 15 02:22:56 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:22:56 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:22:56 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:22:56 user nova-compute[73121]:   </cpu>
Aug 15 02:22:56 user nova-compute[73121]:   <devices>
Aug 15 02:22:56 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:22:56 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:22:56 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue"/>
Aug 15 02:22:56 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:22:56 user nova-compute[73121]:     </disk>
Aug 15 02:22:56 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:22:56 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:22:56 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk"/>
Aug 15 02:22:56 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:22:56 user nova-compute[73121]:     </disk>
Aug 15 02:22:56 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:22:56 user nova-compute[73121]:       <mac address="fa:16:3e:70:dc:15"/>
Aug 15 02:22:56 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:22:56 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:22:56 user nova-compute[73121]:       <target dev="tapd0508681-b7"/>
Aug 15 02:22:56 user nova-compute[73121]:     </interface>
Aug 15 02:22:56 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:22:56 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/console.log" append="off"/>
Aug 15 02:22:56 user nova-compute[73121]:     </serial>
Aug 15 02:22:56 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:22:56 user nova-compute[73121]:     <video>
Aug 15 02:22:56 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:22:56 user nova-compute[73121]:     </video>
Aug 15 02:22:56 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:22:56 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:22:56 user nova-compute[73121]:     </rng>
Aug 15 02:22:56 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:22:56 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:22:56 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:22:56 user nova-compute[73121]:     </memballoon>
Aug 15 02:22:56 user nova-compute[73121]:   </devices>
Aug 15 02:22:56 user nova-compute[73121]: </domain>
Aug 15 02:22:56 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:22:56 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Instance destroyed successfully.
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:22:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No VIF found with MAC fa:16:3e:70:dc:15, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:22:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:22:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-5b4b8ad5-702f-4803-93fb-79ffaedce756 req-8b485a0f-fe1a-4607-b9ee-11bc21488750 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-unplugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:22:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5b4b8ad5-702f-4803-93fb-79ffaedce756 req-8b485a0f-fe1a-4607-b9ee-11bc21488750 service nova] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:22:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5b4b8ad5-702f-4803-93fb-79ffaedce756 req-8b485a0f-fe1a-4607-b9ee-11bc21488750 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:22:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5b4b8ad5-702f-4803-93fb-79ffaedce756 req-8b485a0f-fe1a-4607-b9ee-11bc21488750 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:22:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-5b4b8ad5-702f-4803-93fb-79ffaedce756 req-8b485a0f-fe1a-4607-b9ee-11bc21488750 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] No waiting events found dispatching network-vif-unplugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:22:58 user nova-compute[73121]: WARNING nova.compute.manager [req-5b4b8ad5-702f-4803-93fb-79ffaedce756 req-8b485a0f-fe1a-4607-b9ee-11bc21488750 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received unexpected event network-vif-unplugged-d0508681-b710-480c-9533-73fdf1cb3d7d for instance with vm_state active and task_state rescuing.
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for 22339f3c-9ef1-4630-94c2-a56f0b97aba6 due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066180.1352165, 22339f3c-9ef1-4630-94c2-a56f0b97aba6 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:23:00 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] VM Resumed (Lifecycle Event)
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c4069e87-ecd0-40df-9731-3c8348cd68b9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:23:00 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066180.1390364, 22339f3c-9ef1-4630-94c2-a56f0b97aba6 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:23:00 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] VM Started (Lifecycle Event)
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] No waiting events found dispatching network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:00 user nova-compute[73121]: WARNING nova.compute.manager [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received unexpected event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d for instance with vm_state rescued and task_state None.
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] No waiting events found dispatching network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:00 user nova-compute[73121]: WARNING nova.compute.manager [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received unexpected event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d for instance with vm_state rescued and task_state None.
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:00 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] No waiting events found dispatching network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:00 user nova-compute[73121]: WARNING nova.compute.manager [req-e6403410-1837-402a-9fdd-b627fc386b3b req-19937392-e5d9-4e13-93d5-87e086cf89b3 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received unexpected event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d for instance with vm_state rescued and task_state None.
Aug 15 02:23:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:23:12 user nova-compute[73121]: INFO nova.compute.claims [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Claim successful on node user
Aug 15 02:23:12 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:23:13 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:23:13 user nova-compute[73121]: INFO nova.virt.block_device [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Booting with volume ab6e7dff-15a6-49c9-9849-ea840151270d at /dev/vda
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.policy [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70f546300273431c8f3d51b8a828be22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '810dbe4d00334869a75c7307a19e46e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG os_brick.utils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09f110c-7c40-4db3-abbe-dc0ef0f8ee15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1eb8f3-a5cb-4943-8615-b730e2262cd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f03f1a6-33a0-43ed-b061-2128b97298a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb621845-8b34-4f9a-a1c4-a7878ad05f45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:23:13 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5282ed77-4354-429f-b3c4-17c4f4e404b7]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG os_brick.utils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating existing volume attachment record: f168319e-2100-41bb-a071-79548468b183 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:13 user nova-compute[73121]: INFO nova.compute.manager [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Terminating instance
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-96847fdb-a55b-490d-9dbe-770cd6144af9 req-ac76ae0f-79de-4ef1-ab59-7bd01ae936cf service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-unplugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96847fdb-a55b-490d-9dbe-770cd6144af9 req-ac76ae0f-79de-4ef1-ab59-7bd01ae936cf service nova] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96847fdb-a55b-490d-9dbe-770cd6144af9 req-ac76ae0f-79de-4ef1-ab59-7bd01ae936cf service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-96847fdb-a55b-490d-9dbe-770cd6144af9 req-ac76ae0f-79de-4ef1-ab59-7bd01ae936cf service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-96847fdb-a55b-490d-9dbe-770cd6144af9 req-ac76ae0f-79de-4ef1-ab59-7bd01ae936cf service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] No waiting events found dispatching network-vif-unplugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-96847fdb-a55b-490d-9dbe-770cd6144af9 req-ac76ae0f-79de-4ef1-ab59-7bd01ae936cf service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-unplugged-a6084f1b-a315-4de8-a572-5cf33a871c66 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:23:13 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Successfully created port: d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:23:14 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Instance destroyed successfully.
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.objects.instance [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'resources' on Instance uuid 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:16:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-999784560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-999784560',id=36,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+vKc3yQUIiUeKk+6SqAfOnm7qoBAZhutX2WfEyQ8T7/hQuhg0kOVlZkj8Jg8z3zk8TDB4cIPXK1r6sq0Pvl9/gFMUh98L6bG9QYSc/d2ypUPKtISfwLWz1D/q+9IoS4g==',key_name='tempest-keypair-307324577',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:20:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-4snqcx1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "a6084f1b-a315-4de8-a572-5cf33a871c66", "address": "fa:16:3e:d0:4e:de", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6084f1b-a3", "ovs_interfaceid": "a6084f1b-a315-4de8-a572-5cf33a871c66", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG os_vif [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6084f1b-a3, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:14 user nova-compute[73121]: INFO os_vif [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:4e:de,bridge_name='br-int',has_traffic_filtering=True,id=a6084f1b-a315-4de8-a572-5cf33a871c66,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6084f1b-a3')
Aug 15 02:23:14 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Deleting instance files /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7_del
Aug 15 02:23:14 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Deletion of /opt/stack/data/nova/instances/62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7_del complete
Aug 15 02:23:14 user nova-compute[73121]: INFO nova.compute.manager [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 02:23:14 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Successfully updated port: d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquired lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.compute.manager [req-652387dc-f649-4920-b068-35fb471481c3 req-4a402978-8dbd-4b4c-a882-f37f2c260edc service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.compute.manager [req-652387dc-f649-4920-b068-35fb471481c3 req-4a402978-8dbd-4b4c-a882-f37f2c260edc service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing instance network info cache due to event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-652387dc-f649-4920-b068-35fb471481c3 req-4a402978-8dbd-4b4c-a882-f37f2c260edc service nova] Acquiring lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:23:14 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:15 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Took 0.82 seconds to deallocate network for instance.
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-59ef83ca-bebf-488a-9117-0578d4d41e2c req-708e583b-0215-4002-ac63-88ac6741f0ee service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-deleted-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:15 user nova-compute[73121]: INFO nova.compute.manager [req-59ef83ca-bebf-488a-9117-0578d4d41e2c req-708e583b-0215-4002-ac63-88ac6741f0ee service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Neutron deleted interface a6084f1b-a315-4de8-a572-5cf33a871c66; detaching it from the instance and deleting it from the info cache
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.network.neutron [req-59ef83ca-bebf-488a-9117-0578d4d41e2c req-708e583b-0215-4002-ac63-88ac6741f0ee service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-59ef83ca-bebf-488a-9117-0578d4d41e2c req-708e583b-0215-4002-ac63-88ac6741f0ee service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Detach interface failed, port_id=a6084f1b-a315-4de8-a572-5cf33a871c66, reason: Instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Releasing lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Instance network_info: |[{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-652387dc-f649-4920-b068-35fb471481c3 req-4a402978-8dbd-4b4c-a882-f37f2c260edc service nova] Acquired lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.network.neutron [req-652387dc-f649-4920-b068-35fb471481c3 req-4a402978-8dbd-4b4c-a882-f37f2c260edc service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:23:15 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Deleted allocations for instance 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7
Aug 15 02:23:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-75104390-c830-4778-9282-67090cd41de0 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.250s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-63628078-2900-4014-bf71-71f0ae8b7d08 req-264f3317-a3d4-4f1f-bdf1-9219544e12e2 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63628078-2900-4014-bf71-71f0ae8b7d08 req-264f3317-a3d4-4f1f-bdf1-9219544e12e2 service nova] Acquiring lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63628078-2900-4014-bf71-71f0ae8b7d08 req-264f3317-a3d4-4f1f-bdf1-9219544e12e2 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63628078-2900-4014-bf71-71f0ae8b7d08 req-264f3317-a3d4-4f1f-bdf1-9219544e12e2 service nova] Lock "62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-63628078-2900-4014-bf71-71f0ae8b7d08 req-264f3317-a3d4-4f1f-bdf1-9219544e12e2 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] No waiting events found dispatching network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:15 user nova-compute[73121]: WARNING nova.compute.manager [req-63628078-2900-4014-bf71-71f0ae8b7d08 req-264f3317-a3d4-4f1f-bdf1-9219544e12e2 service nova] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Received unexpected event network-vif-plugged-a6084f1b-a315-4de8-a572-5cf33a871c66 for instance with vm_state deleted and task_state None.
Aug 15 02:23:16 user nova-compute[73121]: DEBUG nova.network.neutron [req-652387dc-f649-4920-b068-35fb471481c3 req-4a402978-8dbd-4b4c-a882-f37f2c260edc service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updated VIF entry in instance network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:23:16 user nova-compute[73121]: DEBUG nova.network.neutron [req-652387dc-f649-4920-b068-35fb471481c3 req-4a402978-8dbd-4b4c-a882-f37f2c260edc service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-652387dc-f649-4920-b068-35fb471481c3 req-4a402978-8dbd-4b4c-a882-f37f2c260edc service nova] Releasing lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:23:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:23:22 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Creating image(s)
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Ensure instance console log exists: /opt/stack/data/nova/instances/716adf87-ce49-44dc-9a75-aa84e27899bb/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Start _get_guest_xml network_info=[{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'f168319e-2100-41bb-a071-79548468b183', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUCHucVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '716adf87-ce49-44dc-9a75-aa84e27899bb', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab6e7dff-15a6-49c9-9849-ea840151270d', 'serial': 'ab6e7dff-15a6-49c9-9849-ea840151270d'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:23:22 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:23:22 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUCHucVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:23:22 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:23:22 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:23:22 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f07e0c8-568a-470c-a0b5-ea6f2c5b69c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:23:22 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80f4201-73a0-40bb-b9b0-4e18cd774c27]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d] added
Aug 15 02:23:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4a6281-a8bb-43ea-90a3-8788cf367e2c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[de63c496-b5b0-4bba-a7ee-02bac14f1ef6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUCHucVO {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUCHucVO" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ae8230-1eca-4c11-8d4b-e5a16d5473b4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUCHucVO'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e1abd6-48c0-4348-91c4-192b9acdd190]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ca082f-5019-49d6-b82f-35de722bdf6f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:23:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:23:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce719383-80f6-49e2-8d66-5505a3254e1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260]
Aug 15 02:23:22 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260] successful.
Aug 15 02:23:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d466f4-7be9-4465-a409-f4a8c006b5c2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afac747-316f-4316-bb81-644687241ed3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:23:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:23:22 user nova-compute[73121]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:23:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:23:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:23:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:23:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:23:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:23 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:23 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec32a148-2b8a-4964-aeeb-b83cd7a82ed6]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:23:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUCHucVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23534323264663138', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534323264663138', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081680432',display_name='tempest-TestShelveInstance-server-2081680432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081680432',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsb/32naL56zFYGKJYVChKcu6sG4pgdZgsBx746CMktm84wViywkiGQGrVGqBMP/vV4JKbvg/e66FF8Cnqz4+6fO0SOR5pSSkPBpgFZ9lkTneyXfb8HU/MoS0rHBa0xtQ==',key_name='tempest-TestShelveInstance-280997968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='810dbe4d00334869a75c7307a19e46e5',ramdisk_id='',reservation_id='r-r9mfxb04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1123354322',owner_user_name='tempest-TestShelveInstance-1123354322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:23:13Z,user_data=None,user_id='70f546300273431c8f3d51b8a828be22',uuid=716adf87-ce49-44dc-9a75-aa84e27899bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converting VIF {"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lazy-loading 'pci_devices' on Instance uuid 716adf87-ce49-44dc-9a75-aa84e27899bb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:23:24 user nova-compute[73121]:   <uuid>716adf87-ce49-44dc-9a75-aa84e27899bb</uuid>
Aug 15 02:23:24 user nova-compute[73121]:   <name>instance-0000002d</name>
Aug 15 02:23:24 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:23:24 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:23:24 user nova-compute[73121]:   <metadata>
Aug 15 02:23:24 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:23:24 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:23:24 user nova-compute[73121]:       <nova:name>tempest-TestShelveInstance-server-2081680432</nova:name>
Aug 15 02:23:24 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:23:22</nova:creationTime>
Aug 15 02:23:24 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:23:24 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:23:24 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:23:24 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:23:24 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:23:24 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:23:24 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:23:24 user nova-compute[73121]:       <nova:owner>
Aug 15 02:23:24 user nova-compute[73121]:         <nova:user uuid="70f546300273431c8f3d51b8a828be22">tempest-TestShelveInstance-1123354322-project-member</nova:user>
Aug 15 02:23:24 user nova-compute[73121]:         <nova:project uuid="810dbe4d00334869a75c7307a19e46e5">tempest-TestShelveInstance-1123354322</nova:project>
Aug 15 02:23:24 user nova-compute[73121]:       </nova:owner>
Aug 15 02:23:24 user nova-compute[73121]:       <nova:ports>
Aug 15 02:23:24 user nova-compute[73121]:         <nova:port uuid="d2e719c6-982b-4d93-a266-8a0dfe7775f6">
Aug 15 02:23:24 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:23:24 user nova-compute[73121]:         </nova:port>
Aug 15 02:23:24 user nova-compute[73121]:       </nova:ports>
Aug 15 02:23:24 user nova-compute[73121]:     </nova:instance>
Aug 15 02:23:24 user nova-compute[73121]:   </metadata>
Aug 15 02:23:24 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:23:24 user nova-compute[73121]:     <system>
Aug 15 02:23:24 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:23:24 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:23:24 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:23:24 user nova-compute[73121]:       <entry name="serial">716adf87-ce49-44dc-9a75-aa84e27899bb</entry>
Aug 15 02:23:24 user nova-compute[73121]:       <entry name="uuid">716adf87-ce49-44dc-9a75-aa84e27899bb</entry>
Aug 15 02:23:24 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:23:24 user nova-compute[73121]:     </system>
Aug 15 02:23:24 user nova-compute[73121]:   </sysinfo>
Aug 15 02:23:24 user nova-compute[73121]:   <os>
Aug 15 02:23:24 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:23:24 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:23:24 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:23:24 user nova-compute[73121]:   </os>
Aug 15 02:23:24 user nova-compute[73121]:   <features>
Aug 15 02:23:24 user nova-compute[73121]:     <acpi/>
Aug 15 02:23:24 user nova-compute[73121]:     <apic/>
Aug 15 02:23:24 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:23:24 user nova-compute[73121]:   </features>
Aug 15 02:23:24 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:23:24 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:23:24 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:23:24 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:23:24 user nova-compute[73121]:   </clock>
Aug 15 02:23:24 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:23:24 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:23:24 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:23:24 user nova-compute[73121]:   </cpu>
Aug 15 02:23:24 user nova-compute[73121]:   <devices>
Aug 15 02:23:24 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:23:24 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:23:24 user nova-compute[73121]:       <source dev="/dev/sdc"/>
Aug 15 02:23:24 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:23:24 user nova-compute[73121]:       <serial>ab6e7dff-15a6-49c9-9849-ea840151270d</serial>
Aug 15 02:23:24 user nova-compute[73121]:     </disk>
Aug 15 02:23:24 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:23:24 user nova-compute[73121]:       <mac address="fa:16:3e:f4:9d:1b"/>
Aug 15 02:23:24 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:23:24 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:23:24 user nova-compute[73121]:       <target dev="tapd2e719c6-98"/>
Aug 15 02:23:24 user nova-compute[73121]:     </interface>
Aug 15 02:23:24 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:23:24 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/716adf87-ce49-44dc-9a75-aa84e27899bb/console.log" append="off"/>
Aug 15 02:23:24 user nova-compute[73121]:     </serial>
Aug 15 02:23:24 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:23:24 user nova-compute[73121]:     <video>
Aug 15 02:23:24 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:23:24 user nova-compute[73121]:     </video>
Aug 15 02:23:24 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:23:24 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:23:24 user nova-compute[73121]:     </rng>
Aug 15 02:23:24 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:23:24 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:23:24 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:23:24 user nova-compute[73121]:     </memballoon>
Aug 15 02:23:24 user nova-compute[73121]:   </devices>
Aug 15 02:23:24 user nova-compute[73121]: </domain>
Aug 15 02:23:24 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081680432',display_name='tempest-TestShelveInstance-server-2081680432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081680432',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsb/32naL56zFYGKJYVChKcu6sG4pgdZgsBx746CMktm84wViywkiGQGrVGqBMP/vV4JKbvg/e66FF8Cnqz4+6fO0SOR5pSSkPBpgFZ9lkTneyXfb8HU/MoS0rHBa0xtQ==',key_name='tempest-TestShelveInstance-280997968',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='810dbe4d00334869a75c7307a19e46e5',ramdisk_id='',reservation_id='r-r9mfxb04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1123354322',owner_user_name='tempest-TestShelveInstance-1123354322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:23:13Z,user_data=None,user_id='70f546300273431c8f3d51b8a828be22',uuid=716adf87-ce49-44dc-9a75-aa84e27899bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converting VIF {"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG os_vif [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2e719c6-98, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2e719c6-98, col_values=(('external_ids', {'iface-id': 'd2e719c6-982b-4d93-a266-8a0dfe7775f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:9d:1b', 'vm-uuid': '716adf87-ce49-44dc-9a75-aa84e27899bb'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:24 user nova-compute[73121]: INFO os_vif [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98')
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:23:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] No VIF found with MAC fa:16:3e:f4:9d:1b, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:23:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-636f9477-a9a0-4630-a554-7c613df20f1a req-0d7f628e-a29a-4b22-8817-51ca9a40f59d service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-636f9477-a9a0-4630-a554-7c613df20f1a req-0d7f628e-a29a-4b22-8817-51ca9a40f59d service nova] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-636f9477-a9a0-4630-a554-7c613df20f1a req-0d7f628e-a29a-4b22-8817-51ca9a40f59d service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-636f9477-a9a0-4630-a554-7c613df20f1a req-0d7f628e-a29a-4b22-8817-51ca9a40f59d service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-636f9477-a9a0-4630-a554-7c613df20f1a req-0d7f628e-a29a-4b22-8817-51ca9a40f59d service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] No waiting events found dispatching network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:25 user nova-compute[73121]: WARNING nova.compute.manager [req-636f9477-a9a0-4630-a554-7c613df20f1a req-0d7f628e-a29a-4b22-8817-51ca9a40f59d service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received unexpected event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 for instance with vm_state building and task_state spawning.
Aug 15 02:23:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066207.4360213, 716adf87-ce49-44dc-9a75-aa84e27899bb => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:23:27 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] VM Resumed (Lifecycle Event)
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:23:27 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Instance spawned successfully.
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:23:27 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066207.4363592, 716adf87-ce49-44dc-9a75-aa84e27899bb => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:23:27 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] VM Started (Lifecycle Event)
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:23:27 user nova-compute[73121]: INFO nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Took 4.90 seconds to spawn the instance on the hypervisor.
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:23:27 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:23:27 user nova-compute[73121]: INFO nova.compute.manager [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Took 15.11 seconds to build instance.
Aug 15 02:23:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d7f4ac6-9085-4d59-917d-9b619bdd63bb tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.245s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ebfb32d0-562e-413c-acb1-11d423d9e8f0 req-0b3d4e63-67b4-48cd-b73c-5dc3a79a49c1 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ebfb32d0-562e-413c-acb1-11d423d9e8f0 req-0b3d4e63-67b4-48cd-b73c-5dc3a79a49c1 service nova] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ebfb32d0-562e-413c-acb1-11d423d9e8f0 req-0b3d4e63-67b4-48cd-b73c-5dc3a79a49c1 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ebfb32d0-562e-413c-acb1-11d423d9e8f0 req-0b3d4e63-67b4-48cd-b73c-5dc3a79a49c1 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-ebfb32d0-562e-413c-acb1-11d423d9e8f0 req-0b3d4e63-67b4-48cd-b73c-5dc3a79a49c1 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] No waiting events found dispatching network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:27 user nova-compute[73121]: WARNING nova.compute.manager [req-ebfb32d0-562e-413c-acb1-11d423d9e8f0 req-0b3d4e63-67b4-48cd-b73c-5dc3a79a49c1 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received unexpected event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 for instance with vm_state active and task_state None.
Aug 15 02:23:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:29 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:23:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:29 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066194.2622037, 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:23:29 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] VM Stopped (Lifecycle Event)
Aug 15 02:23:29 user nova-compute[73121]: DEBUG nova.compute.manager [None req-66d655e7-e04f-4b96-be62-10c5eb582a7f None None] [instance: 62c16f41-0e39-4f1a-ad18-6d4b1ec8baf7] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:23:30 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:23:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:23:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:23:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:34 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:23:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:23:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:23:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:23:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:23:34 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:23:34 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [{"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-6e8f8819-63bf-4c6c-b485-707c9d7f3f55" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:35 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:23:36 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:37 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:23:37 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7786MB free_disk=25.348255157470703GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 454e5897-0179-41fb-a58d-c264831ee4a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 553dea46-d4d3-4362-816f-8c75a73cc65b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 716adf87-ce49-44dc-9a75-aa84e27899bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:23:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:23:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:45 user nova-compute[73121]: INFO nova.compute.manager [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Terminating instance
Aug 15 02:23:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-e18328d0-c915-458a-9805-4eca3b87aa6d req-69a1ce5b-e84a-4b8b-b3db-36e31add2ea5 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-unplugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e18328d0-c915-458a-9805-4eca3b87aa6d req-69a1ce5b-e84a-4b8b-b3db-36e31add2ea5 service nova] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e18328d0-c915-458a-9805-4eca3b87aa6d req-69a1ce5b-e84a-4b8b-b3db-36e31add2ea5 service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e18328d0-c915-458a-9805-4eca3b87aa6d req-69a1ce5b-e84a-4b8b-b3db-36e31add2ea5 service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-e18328d0-c915-458a-9805-4eca3b87aa6d req-69a1ce5b-e84a-4b8b-b3db-36e31add2ea5 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] No waiting events found dispatching network-vif-unplugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-e18328d0-c915-458a-9805-4eca3b87aa6d req-69a1ce5b-e84a-4b8b-b3db-36e31add2ea5 service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-unplugged-7c725b88-d99b-4290-b3e7-6152fb3432ee for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Instance destroyed successfully.
Aug 15 02:23:46 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'resources' on Instance uuid 454e5897-0179-41fb-a58d-c264831ee4a9 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:17:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2101332850',display_name='tempest-ServerActionsTestOtherA-server-2101332850',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2101332850',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdD9feBUtKJxWabCOxeEfVUYblkUx99maantL29ickzkNiSka7JcOd7LAkLzENREY7q67OdhUq5n4xklCuCa82bJF6NH8tngV7k73jmjSgmnNbURsM8zWbxOgcKQEI/Q==',key_name='tempest-keypair-556442797',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:19:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-1c2cui6c',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:20:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=454e5897-0179-41fb-a58d-c264831ee4a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "address": "fa:16:3e:b8:12:7a", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c725b88-d9", "ovs_interfaceid": "7c725b88-d99b-4290-b3e7-6152fb3432ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_vif [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c725b88-d9, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:23:46 user nova-compute[73121]: INFO os_vif [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:12:7a,bridge_name='br-int',has_traffic_filtering=True,id=7c725b88-d99b-4290-b3e7-6152fb3432ee,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c725b88-d9')
Aug 15 02:23:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdtmejLg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:23:46 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[077c498c-b9e5-4ecb-baf9-2f1d732dfe6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf8759-6650-4253-a2f8-baf811af952d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:23:46 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:23:46 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:23:46 user nova-compute[73121]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:23:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 (non-flash)
Aug 15 02:23:46 user nova-compute[73121]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:23:46 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:23:46 user nova-compute[73121]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:23:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc68cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfae644c-c646-47f1-b42e-0520ac0c982b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa2b84-90e2-4c21-a313-130ba9f0a465]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6be6659-1c94-4ba8-afd7-26f1979f7245]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.080s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[721ae0ec-0dd1-4042-be5b-885e8be122ca]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[010cd134-9cff-4dd8-92ed-02d398b25e81]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d25187-a3ae-4771-97ba-45cc026a242e]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260]
Aug 15 02:23:46 user nova-compute[73121]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27, portal: 172.16.0.220,3260] successful.
Aug 15 02:23:46 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a78d1dcd-f1cd-4805-bea8-79afa0919c27 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb507b0-31f1-4560-b651-cd5d10fda966]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] <== disconnect_volume: return (351ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:23:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Deleting instance files /opt/stack/data/nova/instances/454e5897-0179-41fb-a58d-c264831ee4a9_del
Aug 15 02:23:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Deletion of /opt/stack/data/nova/instances/454e5897-0179-41fb-a58d-c264831ee4a9_del complete
Aug 15 02:23:46 user nova-compute[73121]: INFO nova.compute.manager [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 15 02:23:46 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:23:46 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:23:47 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:47 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Took 1.10 seconds to deallocate network for instance.
Aug 15 02:23:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-51136cb4-7a9c-4759-92e3-44eefb2e4a45 req-b67f995c-656b-4e65-b654-9331abbcd85e service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-deleted-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-649b4fd9-7dd2-42b4-9b4a-470ffe0810cd req-d9eed90e-dd45-4710-a83f-f99cf9e1b46c service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-649b4fd9-7dd2-42b4-9b4a-470ffe0810cd req-d9eed90e-dd45-4710-a83f-f99cf9e1b46c service nova] Acquiring lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-649b4fd9-7dd2-42b4-9b4a-470ffe0810cd req-d9eed90e-dd45-4710-a83f-f99cf9e1b46c service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-649b4fd9-7dd2-42b4-9b4a-470ffe0810cd req-d9eed90e-dd45-4710-a83f-f99cf9e1b46c service nova] Lock "454e5897-0179-41fb-a58d-c264831ee4a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:47 user nova-compute[73121]: DEBUG nova.compute.manager [req-649b4fd9-7dd2-42b4-9b4a-470ffe0810cd req-d9eed90e-dd45-4710-a83f-f99cf9e1b46c service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] No waiting events found dispatching network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:47 user nova-compute[73121]: WARNING nova.compute.manager [req-649b4fd9-7dd2-42b4-9b4a-470ffe0810cd req-d9eed90e-dd45-4710-a83f-f99cf9e1b46c service nova] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Received unexpected event network-vif-plugged-7c725b88-d99b-4290-b3e7-6152fb3432ee for instance with vm_state active and task_state deleting.
Aug 15 02:23:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:48 user nova-compute[73121]: INFO nova.compute.manager [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Took 0.79 seconds to detach 1 volumes for instance.
Aug 15 02:23:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Deleting volume: a78d1dcd-f1cd-4805-bea8-79afa0919c27 {{(pid=73121) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 02:23:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:48 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:23:48 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:23:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:48 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Deleted allocations for instance 454e5897-0179-41fb-a58d-c264831ee4a9
Aug 15 02:23:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e6fe871f-b17c-406d-88e4-63b72cc57fe2 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "454e5897-0179-41fb-a58d-c264831ee4a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.702s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-71b8d4e4-d90c-4226-9453-f4be813625b0 req-8b7912fd-85ac-4aa9-87e8-b6637c39167f service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received event network-changed-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-71b8d4e4-d90c-4226-9453-f4be813625b0 req-8b7912fd-85ac-4aa9-87e8-b6637c39167f service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Refreshing instance network info cache due to event network-changed-8983c92e-c4f6-4b11-82a2-accd478d9070. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:23:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-71b8d4e4-d90c-4226-9453-f4be813625b0 req-8b7912fd-85ac-4aa9-87e8-b6637c39167f service nova] Acquiring lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:23:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-71b8d4e4-d90c-4226-9453-f4be813625b0 req-8b7912fd-85ac-4aa9-87e8-b6637c39167f service nova] Acquired lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:23:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-71b8d4e4-d90c-4226-9453-f4be813625b0 req-8b7912fd-85ac-4aa9-87e8-b6637c39167f service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Refreshing network info cache for port 8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:23:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-71b8d4e4-d90c-4226-9453-f4be813625b0 req-8b7912fd-85ac-4aa9-87e8-b6637c39167f service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updated VIF entry in instance network info cache for port 8983c92e-c4f6-4b11-82a2-accd478d9070. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:23:55 user nova-compute[73121]: DEBUG nova.network.neutron [req-71b8d4e4-d90c-4226-9453-f4be813625b0 req-8b7912fd-85ac-4aa9-87e8-b6637c39167f service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updating instance_info_cache with network_info: [{"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-71b8d4e4-d90c-4226-9453-f4be813625b0 req-8b7912fd-85ac-4aa9-87e8-b6637c39167f service nova] Releasing lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:23:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-0c0d2f0c-d5d5-4b14-98d7-26a606d07383 req-4fb9befd-842d-4d49-b6e3-16831ba4d409 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received event network-changed-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-0c0d2f0c-d5d5-4b14-98d7-26a606d07383 req-4fb9befd-842d-4d49-b6e3-16831ba4d409 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Refreshing instance network info cache due to event network-changed-8983c92e-c4f6-4b11-82a2-accd478d9070. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0c0d2f0c-d5d5-4b14-98d7-26a606d07383 req-4fb9befd-842d-4d49-b6e3-16831ba4d409 service nova] Acquiring lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0c0d2f0c-d5d5-4b14-98d7-26a606d07383 req-4fb9befd-842d-4d49-b6e3-16831ba4d409 service nova] Acquired lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG nova.network.neutron [req-0c0d2f0c-d5d5-4b14-98d7-26a606d07383 req-4fb9befd-842d-4d49-b6e3-16831ba4d409 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Refreshing network info cache for port 8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "553dea46-d4d3-4362-816f-8c75a73cc65b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:57 user nova-compute[73121]: INFO nova.compute.manager [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Terminating instance
Aug 15 02:23:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG nova.network.neutron [req-0c0d2f0c-d5d5-4b14-98d7-26a606d07383 req-4fb9befd-842d-4d49-b6e3-16831ba4d409 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updated VIF entry in instance network info cache for port 8983c92e-c4f6-4b11-82a2-accd478d9070. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG nova.network.neutron [req-0c0d2f0c-d5d5-4b14-98d7-26a606d07383 req-4fb9befd-842d-4d49-b6e3-16831ba4d409 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updating instance_info_cache with network_info: [{"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-ce653207-80b4-4852-b612-35fc070357df req-5ab5dd73-be4f-4971-bc01-a934d189cdbb service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received event network-vif-unplugged-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ce653207-80b4-4852-b612-35fc070357df req-5ab5dd73-be4f-4971-bc01-a934d189cdbb service nova] Acquiring lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ce653207-80b4-4852-b612-35fc070357df req-5ab5dd73-be4f-4971-bc01-a934d189cdbb service nova] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ce653207-80b4-4852-b612-35fc070357df req-5ab5dd73-be4f-4971-bc01-a934d189cdbb service nova] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-ce653207-80b4-4852-b612-35fc070357df req-5ab5dd73-be4f-4971-bc01-a934d189cdbb service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] No waiting events found dispatching network-vif-unplugged-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-ce653207-80b4-4852-b612-35fc070357df req-5ab5dd73-be4f-4971-bc01-a934d189cdbb service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received event network-vif-unplugged-8983c92e-c4f6-4b11-82a2-accd478d9070 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:23:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0c0d2f0c-d5d5-4b14-98d7-26a606d07383 req-4fb9befd-842d-4d49-b6e3-16831ba4d409 service nova] Releasing lock "refresh_cache-553dea46-d4d3-4362-816f-8c75a73cc65b" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Instance destroyed successfully.
Aug 15 02:23:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'resources' on Instance uuid 553dea46-d4d3-4362-816f-8c75a73cc65b {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1618481789',display_name='tempest-TestVolumeBootPattern-server-1618481789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1618481789',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuKaje8XOyRteWQDYhsHPlBp1Xjeq99eSrwstRwpVv8kz+qsXnyj4MM3934HkKDRT/PtguSeoZK5bF8tR96SJXazwgYAgV+WiBSzEqWb7KFKLbBhYz1ys01ett7El1jYw==',key_name='tempest-TestVolumeBootPattern-929875393',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:22:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-ipwna84t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:22:18Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=553dea46-d4d3-4362-816f-8c75a73cc65b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "8983c92e-c4f6-4b11-82a2-accd478d9070", "address": "fa:16:3e:b3:a6:b8", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8983c92e-c4", "ovs_interfaceid": "8983c92e-c4f6-4b11-82a2-accd478d9070", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a6:b8,bridge_name='br-int',has_traffic_filtering=True,id=8983c92e-c4f6-4b11-82a2-accd478d9070,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8983c92e-c4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_vif [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a6:b8,bridge_name='br-int',has_traffic_filtering=True,id=8983c92e-c4f6-4b11-82a2-accd478d9070,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8983c92e-c4') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8983c92e-c4, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:23:58 user nova-compute[73121]: INFO os_vif [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:a6:b8,bridge_name='br-int',has_traffic_filtering=True,id=8983c92e-c4f6-4b11-82a2-accd478d9070,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8983c92e-c4')
Aug 15 02:23:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RyMWTVkU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:23:58 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1225cc-e510-402c-9326-15a21f3935d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b9f6d5-7353-4f54-93f9-79bdd2c4b5ae]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:23:58 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:23:58 user nova-compute[73121]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:23:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:23:58 user nova-compute[73121]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf (non-flash)
Aug 15 02:23:58 user nova-compute[73121]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:23:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc44f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf'): ({'sdf'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Removing single pathed devices sdf {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee87c03-c745-4985-b6a3-bd9b2e235621]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c404cc9-669b-407b-825a-bf0ee86afc3f]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flushing IO for device /dev/sdf {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[23880bbf-0491-4edf-85d6-99156de5e630]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a1898e-13f9-4dc2-bfdc-61eb93a581f4]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] SCSI volumes sdf have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.053s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29e9755-8f2a-45aa-9987-fada1bf3ee48]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[902bda64-e495-4717-8b8b-862084262511]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf, portal: 172.16.0.220,3260]
Aug 15 02:23:58 user nova-compute[73121]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf, portal: 172.16.0.220,3260] successful.
Aug 15 02:23:58 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cc9bb027-06cd-41b0-abb7-9d0bb32deedf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1112d6-2ed7-41f0-95e5-13d85d753586]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== disconnect_volume: return (339ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:23:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Deleting instance files /opt/stack/data/nova/instances/553dea46-d4d3-4362-816f-8c75a73cc65b_del
Aug 15 02:23:58 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Deletion of /opt/stack/data/nova/instances/553dea46-d4d3-4362-816f-8c75a73cc65b_del complete
Aug 15 02:23:58 user nova-compute[73121]: INFO nova.compute.manager [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 15 02:23:58 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:23:59 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:59 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Took 0.57 seconds to deallocate network for instance.
Aug 15 02:23:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-6bef161d-2837-4119-ba87-dceef630845e req-b3ccbe6c-7aba-4fcd-beec-86ad6d61d66c service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received event network-vif-deleted-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:59 user nova-compute[73121]: INFO nova.compute.manager [req-6bef161d-2837-4119-ba87-dceef630845e req-b3ccbe6c-7aba-4fcd-beec-86ad6d61d66c service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Neutron deleted interface 8983c92e-c4f6-4b11-82a2-accd478d9070; detaching it from the instance and deleting it from the info cache
Aug 15 02:23:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-6bef161d-2837-4119-ba87-dceef630845e req-b3ccbe6c-7aba-4fcd-beec-86ad6d61d66c service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:23:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-6bef161d-2837-4119-ba87-dceef630845e req-b3ccbe6c-7aba-4fcd-beec-86ad6d61d66c service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Detach interface failed, port_id=8983c92e-c4f6-4b11-82a2-accd478d9070, reason: Instance 553dea46-d4d3-4362-816f-8c75a73cc65b could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:23:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-030f7631-469a-42a8-88da-82ad9734814f req-d8eae36a-2936-4121-953d-c7f43964b831 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received event network-vif-plugged-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:23:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-030f7631-469a-42a8-88da-82ad9734814f req-d8eae36a-2936-4121-953d-c7f43964b831 service nova] Acquiring lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:23:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-030f7631-469a-42a8-88da-82ad9734814f req-d8eae36a-2936-4121-953d-c7f43964b831 service nova] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:23:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-030f7631-469a-42a8-88da-82ad9734814f req-d8eae36a-2936-4121-953d-c7f43964b831 service nova] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:23:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-030f7631-469a-42a8-88da-82ad9734814f req-d8eae36a-2936-4121-953d-c7f43964b831 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] No waiting events found dispatching network-vif-plugged-8983c92e-c4f6-4b11-82a2-accd478d9070 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:23:59 user nova-compute[73121]: WARNING nova.compute.manager [req-030f7631-469a-42a8-88da-82ad9734814f req-d8eae36a-2936-4121-953d-c7f43964b831 service nova] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Received unexpected event network-vif-plugged-8983c92e-c4f6-4b11-82a2-accd478d9070 for instance with vm_state active and task_state deleting.
Aug 15 02:23:59 user nova-compute[73121]: INFO nova.compute.manager [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Took 0.74 seconds to detach 1 volumes for instance.
Aug 15 02:24:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:00 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:24:00 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:24:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:00 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Deleted allocations for instance 553dea46-d4d3-4362-816f-8c75a73cc65b
Aug 15 02:24:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ed4a70d-fa5d-427e-92d8-197199d92d1c tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "553dea46-d4d3-4362-816f-8c75a73cc65b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.028s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:01 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066226.0778513, 454e5897-0179-41fb-a58d-c264831ee4a9 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:24:01 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] VM Stopped (Lifecycle Event)
Aug 15 02:24:01 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0e929cea-e3b0-4ba9-b584-3ac49bbbe128 None None] [instance: 454e5897-0179-41fb-a58d-c264831ee4a9] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:24:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:24:08 user nova-compute[73121]: INFO nova.compute.claims [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Claim successful on node user
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:24:08 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.policy [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6321528a357e45878a851a10e78226a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203875f0947a423faf1ae9930f401026', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:24:08 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Creating image(s)
Aug 15 02:24:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.219s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk 1073741824" returned: 0 in 0.066s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Successfully created port: 2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Cannot resize image /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'migration_context' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Ensure instance console log exists: /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Successfully updated port: 2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG nova.compute.manager [req-fc652974-18ef-467b-be41-4d525f873607 req-e59c5487-1747-469f-8383-285cb92f1b36 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-changed-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG nova.compute.manager [req-fc652974-18ef-467b-be41-4d525f873607 req-e59c5487-1747-469f-8383-285cb92f1b36 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Refreshing instance network info cache due to event network-changed-2225348a-2bc9-438d-810a-9702d8bc4cfe. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fc652974-18ef-467b-be41-4d525f873607 req-e59c5487-1747-469f-8383-285cb92f1b36 service nova] Acquiring lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fc652974-18ef-467b-be41-4d525f873607 req-e59c5487-1747-469f-8383-285cb92f1b36 service nova] Acquired lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG nova.network.neutron [req-fc652974-18ef-467b-be41-4d525f873607 req-e59c5487-1747-469f-8383-285cb92f1b36 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Refreshing network info cache for port 2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG nova.network.neutron [req-fc652974-18ef-467b-be41-4d525f873607 req-e59c5487-1747-469f-8383-285cb92f1b36 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG nova.network.neutron [req-fc652974-18ef-467b-be41-4d525f873607 req-e59c5487-1747-469f-8383-285cb92f1b36 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fc652974-18ef-467b-be41-4d525f873607 req-e59c5487-1747-469f-8383-285cb92f1b36 service nova] Releasing lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquired lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:24:10 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updating instance_info_cache with network_info: [{"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Releasing lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance network_info: |[{"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Start _get_guest_xml network_info=[{"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:24:11 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:24:11 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:24:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1573016178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1573016178',id=46,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0CybmE9myuAGhYvCYfuBxDAuo6u0/SHZffq95vLxhi23l3anIGFkGaWmCRHH5OlrGTkqQR2IC8QlJhrL9PLUl24i6sCHujzNc9h3kZfqSh+4Yem/ymmndCH/2pT8Nk5Q==',key_name='tempest-keypair-742960521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-wwtuzahc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'pci_devices' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:24:11 user nova-compute[73121]:   <uuid>ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f</uuid>
Aug 15 02:24:11 user nova-compute[73121]:   <name>instance-0000002e</name>
Aug 15 02:24:11 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:24:11 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:24:11 user nova-compute[73121]:   <metadata>
Aug 15 02:24:11 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:24:11 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:24:11 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1573016178</nova:name>
Aug 15 02:24:11 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:24:11</nova:creationTime>
Aug 15 02:24:11 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:24:11 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:24:11 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:24:11 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:24:11 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:24:11 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:24:11 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:24:11 user nova-compute[73121]:       <nova:owner>
Aug 15 02:24:11 user nova-compute[73121]:         <nova:user uuid="6321528a357e45878a851a10e78226a4">tempest-AttachVolumeShelveTestJSON-201192507-project-member</nova:user>
Aug 15 02:24:11 user nova-compute[73121]:         <nova:project uuid="203875f0947a423faf1ae9930f401026">tempest-AttachVolumeShelveTestJSON-201192507</nova:project>
Aug 15 02:24:11 user nova-compute[73121]:       </nova:owner>
Aug 15 02:24:11 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:24:11 user nova-compute[73121]:       <nova:ports>
Aug 15 02:24:11 user nova-compute[73121]:         <nova:port uuid="2225348a-2bc9-438d-810a-9702d8bc4cfe">
Aug 15 02:24:11 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:24:11 user nova-compute[73121]:         </nova:port>
Aug 15 02:24:11 user nova-compute[73121]:       </nova:ports>
Aug 15 02:24:11 user nova-compute[73121]:     </nova:instance>
Aug 15 02:24:11 user nova-compute[73121]:   </metadata>
Aug 15 02:24:11 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:24:11 user nova-compute[73121]:     <system>
Aug 15 02:24:11 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:24:11 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:24:11 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:24:11 user nova-compute[73121]:       <entry name="serial">ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f</entry>
Aug 15 02:24:11 user nova-compute[73121]:       <entry name="uuid">ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f</entry>
Aug 15 02:24:11 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:24:11 user nova-compute[73121]:     </system>
Aug 15 02:24:11 user nova-compute[73121]:   </sysinfo>
Aug 15 02:24:11 user nova-compute[73121]:   <os>
Aug 15 02:24:11 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:24:11 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:24:11 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:24:11 user nova-compute[73121]:   </os>
Aug 15 02:24:11 user nova-compute[73121]:   <features>
Aug 15 02:24:11 user nova-compute[73121]:     <acpi/>
Aug 15 02:24:11 user nova-compute[73121]:     <apic/>
Aug 15 02:24:11 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:24:11 user nova-compute[73121]:   </features>
Aug 15 02:24:11 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:24:11 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:24:11 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:24:11 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:24:11 user nova-compute[73121]:   </clock>
Aug 15 02:24:11 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:24:11 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:24:11 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:24:11 user nova-compute[73121]:   </cpu>
Aug 15 02:24:11 user nova-compute[73121]:   <devices>
Aug 15 02:24:11 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:24:11 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:24:11 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk"/>
Aug 15 02:24:11 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:24:11 user nova-compute[73121]:     </disk>
Aug 15 02:24:11 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:24:11 user nova-compute[73121]:       <mac address="fa:16:3e:3e:5f:86"/>
Aug 15 02:24:11 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:24:11 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:24:11 user nova-compute[73121]:       <target dev="tap2225348a-2b"/>
Aug 15 02:24:11 user nova-compute[73121]:     </interface>
Aug 15 02:24:11 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:24:11 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/console.log" append="off"/>
Aug 15 02:24:11 user nova-compute[73121]:     </serial>
Aug 15 02:24:11 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:24:11 user nova-compute[73121]:     <video>
Aug 15 02:24:11 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:24:11 user nova-compute[73121]:     </video>
Aug 15 02:24:11 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:24:11 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:24:11 user nova-compute[73121]:     </rng>
Aug 15 02:24:11 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:24:11 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:24:11 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:24:11 user nova-compute[73121]:     </memballoon>
Aug 15 02:24:11 user nova-compute[73121]:   </devices>
Aug 15 02:24:11 user nova-compute[73121]: </domain>
Aug 15 02:24:11 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:24:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1573016178',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1573016178',id=46,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0CybmE9myuAGhYvCYfuBxDAuo6u0/SHZffq95vLxhi23l3anIGFkGaWmCRHH5OlrGTkqQR2IC8QlJhrL9PLUl24i6sCHujzNc9h3kZfqSh+4Yem/ymmndCH/2pT8Nk5Q==',key_name='tempest-keypair-742960521',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-wwtuzahc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:24:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG os_vif [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2225348a-2b, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2225348a-2b, col_values=(('external_ids', {'iface-id': '2225348a-2bc9-438d-810a-9702d8bc4cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:5f:86', 'vm-uuid': 'ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:11 user nova-compute[73121]: INFO os_vif [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b')
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:24:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] No VIF found with MAC fa:16:3e:3e:5f:86, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:24:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-f4f5d408-a182-4334-bd39-cd7b872d7d35 req-d9afe5b4-9aca-4c1f-9be6-316d87af7b16 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:24:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f4f5d408-a182-4334-bd39-cd7b872d7d35 req-d9afe5b4-9aca-4c1f-9be6-316d87af7b16 service nova] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f4f5d408-a182-4334-bd39-cd7b872d7d35 req-d9afe5b4-9aca-4c1f-9be6-316d87af7b16 service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f4f5d408-a182-4334-bd39-cd7b872d7d35 req-d9afe5b4-9aca-4c1f-9be6-316d87af7b16 service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-f4f5d408-a182-4334-bd39-cd7b872d7d35 req-d9afe5b4-9aca-4c1f-9be6-316d87af7b16 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] No waiting events found dispatching network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:24:12 user nova-compute[73121]: WARNING nova.compute.manager [req-f4f5d408-a182-4334-bd39-cd7b872d7d35 req-d9afe5b4-9aca-4c1f-9be6-316d87af7b16 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received unexpected event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe for instance with vm_state building and task_state spawning.
Aug 15 02:24:13 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066238.203059, 553dea46-d4d3-4362-816f-8c75a73cc65b => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:24:13 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] VM Stopped (Lifecycle Event)
Aug 15 02:24:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d7a1d6c4-3c95-4b1a-aa90-d3083c870739 None None] [instance: 553dea46-d4d3-4362-816f-8c75a73cc65b] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:24:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066254.936212, ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:24:14 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] VM Resumed (Lifecycle Event)
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:24:14 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance spawned successfully.
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:24:14 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:24:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:24:15 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:24:15 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:24:15 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066254.9397383, ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:24:15 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] VM Started (Lifecycle Event)
Aug 15 02:24:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-7c9f1246-032a-430e-b4fd-497f7f1c2277 req-3c938487-8507-44b9-bcfd-bac73a65419b service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:24:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7c9f1246-032a-430e-b4fd-497f7f1c2277 req-3c938487-8507-44b9-bcfd-bac73a65419b service nova] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7c9f1246-032a-430e-b4fd-497f7f1c2277 req-3c938487-8507-44b9-bcfd-bac73a65419b service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-7c9f1246-032a-430e-b4fd-497f7f1c2277 req-3c938487-8507-44b9-bcfd-bac73a65419b service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:15 user nova-compute[73121]: DEBUG nova.compute.manager [req-7c9f1246-032a-430e-b4fd-497f7f1c2277 req-3c938487-8507-44b9-bcfd-bac73a65419b service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] No waiting events found dispatching network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:24:15 user nova-compute[73121]: WARNING nova.compute.manager [req-7c9f1246-032a-430e-b4fd-497f7f1c2277 req-3c938487-8507-44b9-bcfd-bac73a65419b service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received unexpected event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe for instance with vm_state building and task_state spawning.
Aug 15 02:24:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:24:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:24:15 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:24:15 user nova-compute[73121]: INFO nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Took 6.19 seconds to spawn the instance on the hypervisor.
Aug 15 02:24:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:24:15 user nova-compute[73121]: INFO nova.compute.manager [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Took 6.98 seconds to build instance.
Aug 15 02:24:15 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ce788a1a-3068-46e9-a61c-f63e0eb12112 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.107s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:24:28 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:24:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:24:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:24:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:24:35 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:24:35 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updating instance_info_cache with network_info: [{"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:24:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:24:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:24:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:36 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:24:39 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:24:39 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=7883MB free_disk=25.316978454589844GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 716adf87-ce49-44dc-9a75-aa84e27899bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:24:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:42 user nova-compute[73121]: INFO nova.compute.manager [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Terminating instance
Aug 15 02:24:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-6141e903-b9ab-49aa-bcd5-f67bc36ecd19 req-0eb8e384-ca91-489c-ba25-1bd674a975ee service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received event network-vif-unplugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6141e903-b9ab-49aa-bcd5-f67bc36ecd19 req-0eb8e384-ca91-489c-ba25-1bd674a975ee service nova] Acquiring lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6141e903-b9ab-49aa-bcd5-f67bc36ecd19 req-0eb8e384-ca91-489c-ba25-1bd674a975ee service nova] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6141e903-b9ab-49aa-bcd5-f67bc36ecd19 req-0eb8e384-ca91-489c-ba25-1bd674a975ee service nova] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-6141e903-b9ab-49aa-bcd5-f67bc36ecd19 req-0eb8e384-ca91-489c-ba25-1bd674a975ee service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] No waiting events found dispatching network-vif-unplugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-6141e903-b9ab-49aa-bcd5-f67bc36ecd19 req-0eb8e384-ca91-489c-ba25-1bd674a975ee service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received event network-vif-unplugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:24:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Instance destroyed successfully.
Aug 15 02:24:43 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lazy-loading 'resources' on Instance uuid 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:05:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-107880846',display_name='tempest-ServerActionsTestOtherA-server-107880846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-107880846',id=18,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdD9feBUtKJxWabCOxeEfVUYblkUx99maantL29ickzkNiSka7JcOd7LAkLzENREY7q67OdhUq5n4xklCuCa82bJF6NH8tngV7k73jmjSgmnNbURsM8zWbxOgcKQEI/Q==',key_name='tempest-keypair-556442797',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:05:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0739b6fd0a4c3097a1e0d329176a78',ramdisk_id='',reservation_id='r-6f0859bo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-148244694',owner_user_name='tempest-ServerActionsTestOtherA-148244694-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:05:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f22753e4f3934dddab87961c43c68fb2',uuid=6e8f8819-63bf-4c6c-b485-707c9d7f3f55,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converting VIF {"id": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "address": "fa:16:3e:5e:1e:e7", "network": {"id": "d63d77c9-0528-4dbe-80b0-ede4659a15e0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1247729830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0739b6fd0a4c3097a1e0d329176a78", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce335a5-d4", "ovs_interfaceid": "3ce335a5-d497-4e7a-ac6f-0e281c42cafb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:1e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3ce335a5-d497-4e7a-ac6f-0e281c42cafb,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce335a5-d4') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG os_vif [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:1e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3ce335a5-d497-4e7a-ac6f-0e281c42cafb,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce335a5-d4') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ce335a5-d4, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:24:43 user nova-compute[73121]: INFO os_vif [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:1e:e7,bridge_name='br-int',has_traffic_filtering=True,id=3ce335a5-d497-4e7a-ac6f-0e281c42cafb,network=Network(d63d77c9-0528-4dbe-80b0-ede4659a15e0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce335a5-d4')
Aug 15 02:24:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Deleting instance files /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55_del
Aug 15 02:24:43 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Deletion of /opt/stack/data/nova/instances/6e8f8819-63bf-4c6c-b485-707c9d7f3f55_del complete
Aug 15 02:24:43 user nova-compute[73121]: INFO nova.compute.manager [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 02:24:43 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:24:43 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:24:43 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Took 0.52 seconds to deallocate network for instance.
Aug 15 02:24:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-9fa00962-7fa4-4a20-a080-092eb227af01 req-297ac9d0-b915-4151-9520-27a577b5a7c5 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received event network-vif-deleted-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:24:43 user nova-compute[73121]: INFO nova.compute.manager [req-9fa00962-7fa4-4a20-a080-092eb227af01 req-297ac9d0-b915-4151-9520-27a577b5a7c5 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Neutron deleted interface 3ce335a5-d497-4e7a-ac6f-0e281c42cafb; detaching it from the instance and deleting it from the info cache
Aug 15 02:24:43 user nova-compute[73121]: DEBUG nova.network.neutron [req-9fa00962-7fa4-4a20-a080-092eb227af01 req-297ac9d0-b915-4151-9520-27a577b5a7c5 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:24:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-9fa00962-7fa4-4a20-a080-092eb227af01 req-297ac9d0-b915-4151-9520-27a577b5a7c5 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Detach interface failed, port_id=3ce335a5-d497-4e7a-ac6f-0e281c42cafb, reason: Instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:24:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:44 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:24:44 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:24:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:44 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Deleted allocations for instance 6e8f8819-63bf-4c6c-b485-707c9d7f3f55
Aug 15 02:24:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0200bde6-eeab-471f-89a4-65aae7feff03 tempest-ServerActionsTestOtherA-148244694 tempest-ServerActionsTestOtherA-148244694-project-member] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-fa77e89d-6b14-498d-a0f3-402faff3e8fd req-3cc8cb7d-d4f9-45d6-92fb-55bb2b2c0741 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received event network-vif-plugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:24:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fa77e89d-6b14-498d-a0f3-402faff3e8fd req-3cc8cb7d-d4f9-45d6-92fb-55bb2b2c0741 service nova] Acquiring lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fa77e89d-6b14-498d-a0f3-402faff3e8fd req-3cc8cb7d-d4f9-45d6-92fb-55bb2b2c0741 service nova] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fa77e89d-6b14-498d-a0f3-402faff3e8fd req-3cc8cb7d-d4f9-45d6-92fb-55bb2b2c0741 service nova] Lock "6e8f8819-63bf-4c6c-b485-707c9d7f3f55-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-fa77e89d-6b14-498d-a0f3-402faff3e8fd req-3cc8cb7d-d4f9-45d6-92fb-55bb2b2c0741 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] No waiting events found dispatching network-vif-plugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:24:45 user nova-compute[73121]: WARNING nova.compute.manager [req-fa77e89d-6b14-498d-a0f3-402faff3e8fd req-3cc8cb7d-d4f9-45d6-92fb-55bb2b2c0741 service nova] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Received unexpected event network-vif-plugged-3ce335a5-d497-4e7a-ac6f-0e281c42cafb for instance with vm_state deleted and task_state None.
Aug 15 02:24:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:24:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:58 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066283.3438208, 6e8f8819-63bf-4c6c-b485-707c9d7f3f55 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:24:58 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] VM Stopped (Lifecycle Event)
Aug 15 02:24:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3ac3f58a-ecf0-4745-b48f-c095497d770b None None] [instance: 6e8f8819-63bf-4c6c-b485-707c9d7f3f55] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:24:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-9b26f74f-44e6-4ab4-9e8f-be195f943c1a req-89c35aa1-14e9-4bc0-9e5e-f13e5af4c6dd service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received event network-changed-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-9b26f74f-44e6-4ab4-9e8f-be195f943c1a req-89c35aa1-14e9-4bc0-9e5e-f13e5af4c6dd service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Refreshing instance network info cache due to event network-changed-d971bce8-66de-4835-b772-b89e99985897. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9b26f74f-44e6-4ab4-9e8f-be195f943c1a req-89c35aa1-14e9-4bc0-9e5e-f13e5af4c6dd service nova] Acquiring lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9b26f74f-44e6-4ab4-9e8f-be195f943c1a req-89c35aa1-14e9-4bc0-9e5e-f13e5af4c6dd service nova] Acquired lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-9b26f74f-44e6-4ab4-9e8f-be195f943c1a req-89c35aa1-14e9-4bc0-9e5e-f13e5af4c6dd service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Refreshing network info cache for port d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:24:59 user nova-compute[73121]: INFO nova.compute.manager [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Terminating instance
Aug 15 02:24:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:24:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.network.neutron [req-9b26f74f-44e6-4ab4-9e8f-be195f943c1a req-89c35aa1-14e9-4bc0-9e5e-f13e5af4c6dd service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updated VIF entry in instance network info cache for port d971bce8-66de-4835-b772-b89e99985897. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.network.neutron [req-9b26f74f-44e6-4ab4-9e8f-be195f943c1a req-89c35aa1-14e9-4bc0-9e5e-f13e5af4c6dd service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updating instance_info_cache with network_info: [{"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9b26f74f-44e6-4ab4-9e8f-be195f943c1a req-89c35aa1-14e9-4bc0-9e5e-f13e5af4c6dd service nova] Releasing lock "refresh_cache-1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:25:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Instance destroyed successfully.
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.objects.instance [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lazy-loading 'resources' on Instance uuid 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:19:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-37434961',display_name='tempest-TestVolumeBootPattern-server-37434961',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-37434961',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuKaje8XOyRteWQDYhsHPlBp1Xjeq99eSrwstRwpVv8kz+qsXnyj4MM3934HkKDRT/PtguSeoZK5bF8tR96SJXazwgYAgV+WiBSzEqWb7KFKLbBhYz1ys01ett7El1jYw==',key_name='tempest-TestVolumeBootPattern-929875393',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:20:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e3397dd14ca44c19dc4386aec30a9a4',ramdisk_id='',reservation_id='r-tu3ub5w8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-151395753',owner_user_name='tempest-TestVolumeBootPattern-151395753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:20:14Z,user_data=None,user_id='9f9c4f2ffebb440cb88132a502d51811',uuid=1cdacf7e-1d4d-4e58-857a-f70a0bf84d17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converting VIF {"id": "d971bce8-66de-4835-b772-b89e99985897", "address": "fa:16:3e:e0:7e:9f", "network": {"id": "a27def12-6e01-4f41-9302-f6e36098934d", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1694460285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e3397dd14ca44c19dc4386aec30a9a4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd971bce8-66", "ovs_interfaceid": "d971bce8-66de-4835-b772-b89e99985897", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d971bce8-66de-4835-b772-b89e99985897,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971bce8-66') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_vif [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d971bce8-66de-4835-b772-b89e99985897,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971bce8-66') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd971bce8-66, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:25:00 user nova-compute[73121]: INFO os_vif [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:7e:9f,bridge_name='br-int',has_traffic_filtering=True,id=d971bce8-66de-4835-b772-b89e99985897,network=Network(a27def12-6e01-4f41-9302-f6e36098934d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd971bce8-66')
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TvzRfCyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:25:00 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[980cb664-af82-46da-bd7c-7c6d16eae95a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcbdd4e-95f4-4d5b-be88-43e5ddd85a82]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:25:00 user nova-compute[73121]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:25:00 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d (non-flash)
Aug 15 02:25:00 user nova-compute[73121]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:25:00 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e20799750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d'): ({'sdd'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Removing single pathed devices sdd {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef9b1f1-fade-4734-a421-4e0bab85ae18]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8debd8-98d2-4102-bf0d-9d3288552d0f]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Flushing IO for device /dev/sdd {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[80281e36-252a-4191-827c-1a4e6ec6691a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcabdad-ff23-466a-b2db-ca66eea6a843]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] SCSI volumes sdd have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb79ababc-209751dc09e52196', '/dev/disk/by-id/scsi-23230393735316463', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b79ababc') {{(pid=84043) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3261212-0dda-48f5-be10-40160c7c55de]: (4, None) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a6cbb-b3fa-4ad5-8db6-70fa07c8faf0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c455327b-0629-494b-b3a7-7cf0b2492798]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260]
Aug 15 02:25:00 user nova-compute[73121]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d, portal: 172.16.0.220,3260] successful.
Aug 15 02:25:00 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8227d1ba-6670-4189-85dd-7d91a9409e5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e506f3a3-cc54-41fd-8e3c-89b9cdea7f5a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] <== disconnect_volume: return (270ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:25:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Deleting instance files /opt/stack/data/nova/instances/1cdacf7e-1d4d-4e58-857a-f70a0bf84d17_del
Aug 15 02:25:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Deletion of /opt/stack/data/nova/instances/1cdacf7e-1d4d-4e58-857a-f70a0bf84d17_del complete
Aug 15 02:25:00 user nova-compute[73121]: INFO nova.compute.manager [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 15 02:25:00 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:25:00 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received event network-vif-unplugged-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] Acquiring lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] No waiting events found dispatching network-vif-unplugged-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received event network-vif-unplugged-d971bce8-66de-4835-b772-b89e99985897 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received event network-vif-plugged-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] Acquiring lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] No waiting events found dispatching network-vif-plugged-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:01 user nova-compute[73121]: WARNING nova.compute.manager [req-9cb34360-6089-4e94-bc8b-51c180fd3ab4 req-2620c7a1-5fed-4dbd-8f81-27c6050de53e service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received unexpected event network-vif-plugged-d971bce8-66de-4835-b772-b89e99985897 for instance with vm_state active and task_state deleting.
Aug 15 02:25:01 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:25:02 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Took 1.07 seconds to deallocate network for instance.
Aug 15 02:25:02 user nova-compute[73121]: INFO nova.compute.manager [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Took 0.74 seconds to detach 1 volumes for instance.
Aug 15 02:25:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:02 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:25:02 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:25:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:03 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Deleted allocations for instance 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17
Aug 15 02:25:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-552875af-93f7-4e76-96ed-4e5121d3dbd0 tempest-TestVolumeBootPattern-151395753 tempest-TestVolumeBootPattern-151395753-project-member] Lock "1cdacf7e-1d4d-4e58-857a-f70a0bf84d17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.278s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-4afd3a2d-83ae-4660-a864-1b09969967c5 req-a1624fc5-95b7-43a6-b706-a72d5de83b2e service nova] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Received event network-vif-deleted-d971bce8-66de-4835-b772-b89e99985897 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-75b0f113-0ae9-4b79-8af4-bc49673a4a32 req-25931fc1-6569-4f7e-8413-91e1a9f2fba3 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-75b0f113-0ae9-4b79-8af4-bc49673a4a32 req-25931fc1-6569-4f7e-8413-91e1a9f2fba3 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing instance network info cache due to event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:25:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-75b0f113-0ae9-4b79-8af4-bc49673a4a32 req-25931fc1-6569-4f7e-8413-91e1a9f2fba3 service nova] Acquiring lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:25:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-75b0f113-0ae9-4b79-8af4-bc49673a4a32 req-25931fc1-6569-4f7e-8413-91e1a9f2fba3 service nova] Acquired lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:25:04 user nova-compute[73121]: DEBUG nova.network.neutron [req-75b0f113-0ae9-4b79-8af4-bc49673a4a32 req-25931fc1-6569-4f7e-8413-91e1a9f2fba3 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:25:05 user nova-compute[73121]: DEBUG nova.network.neutron [req-75b0f113-0ae9-4b79-8af4-bc49673a4a32 req-25931fc1-6569-4f7e-8413-91e1a9f2fba3 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updated VIF entry in instance network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:25:05 user nova-compute[73121]: DEBUG nova.network.neutron [req-75b0f113-0ae9-4b79-8af4-bc49673a4a32 req-25931fc1-6569-4f7e-8413-91e1a9f2fba3 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:25:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-75b0f113-0ae9-4b79-8af4-bc49673a4a32 req-25931fc1-6569-4f7e-8413-91e1a9f2fba3 service nova] Releasing lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:25:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:05 user nova-compute[73121]: INFO nova.compute.manager [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Shelve offloading
Aug 15 02:25:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-6dcd303c-a3bd-4870-9618-06581b36659c req-33b3b87a-ea39-4262-ac87-4f1d27de36d5 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-unplugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6dcd303c-a3bd-4870-9618-06581b36659c req-33b3b87a-ea39-4262-ac87-4f1d27de36d5 service nova] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6dcd303c-a3bd-4870-9618-06581b36659c req-33b3b87a-ea39-4262-ac87-4f1d27de36d5 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6dcd303c-a3bd-4870-9618-06581b36659c req-33b3b87a-ea39-4262-ac87-4f1d27de36d5 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-6dcd303c-a3bd-4870-9618-06581b36659c req-33b3b87a-ea39-4262-ac87-4f1d27de36d5 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] No waiting events found dispatching network-vif-unplugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:06 user nova-compute[73121]: WARNING nova.compute.manager [req-6dcd303c-a3bd-4870-9618-06581b36659c req-33b3b87a-ea39-4262-ac87-4f1d27de36d5 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received unexpected event network-vif-unplugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 for instance with vm_state active and task_state shelving.
Aug 15 02:25:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Instance destroyed successfully.
Aug 15 02:25:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquired lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG nova.network.neutron [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG nova.network.neutron [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:25:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Releasing lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:25:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Instance destroyed successfully.
Aug 15 02:25:07 user nova-compute[73121]: DEBUG nova.objects.instance [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lazy-loading 'resources' on Instance uuid 716adf87-ce49-44dc-9a75-aa84e27899bb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081680432',display_name='tempest-TestShelveInstance-server-2081680432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081680432',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsb/32naL56zFYGKJYVChKcu6sG4pgdZgsBx746CMktm84wViywkiGQGrVGqBMP/vV4JKbvg/e66FF8Cnqz4+6fO0SOR5pSSkPBpgFZ9lkTneyXfb8HU/MoS0rHBa0xtQ==',key_name='tempest-TestShelveInstance-280997968',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:23:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='810dbe4d00334869a75c7307a19e46e5',ramdisk_id='',reservation_id='r-r9mfxb04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1123354322',owner_user_name='tempest-TestShelveInstance-1123354322-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:23:28Z,user_data=None,user_id='70f546300273431c8f3d51b8a828be22',uuid=716adf87-ce49-44dc-9a75-aa84e27899bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converting VIF {"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_vif [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2e719c6-98, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:25:07 user nova-compute[73121]: INFO os_vif [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98')
Aug 15 02:25:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUCHucVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:25:07 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-dbd9e962-9983-4303-87af-e866b85289ae req-1250eea2-7876-424d-8a4a-de63bfb9bb2e service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-dbd9e962-9983-4303-87af-e866b85289ae req-1250eea2-7876-424d-8a4a-de63bfb9bb2e service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing instance network info cache due to event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dbd9e962-9983-4303-87af-e866b85289ae req-1250eea2-7876-424d-8a4a-de63bfb9bb2e service nova] Acquiring lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dbd9e962-9983-4303-87af-e866b85289ae req-1250eea2-7876-424d-8a4a-de63bfb9bb2e service nova] Acquired lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG nova.network.neutron [req-dbd9e962-9983-4303-87af-e866b85289ae req-1250eea2-7876-424d-8a4a-de63bfb9bb2e service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c170736-0c21-46a0-9942-3b3752fe1f63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f708f6f3-cac3-4e4e-9a7b-f2209cc713de]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:25:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:25:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc44f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[73faf098-00f4-4e57-93d7-a6c39bc1b5a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f9c472-f025-4edc-8002-57dd5812b1d4]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18efa21-b307-4973-8bb5-3a3929f51fe2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3141134-d889-4f22-88b1-112b079d05f1]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b13a1a-270b-4f41-ba6e-d8f704dc9d6e]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e880720-9749-41b9-98a1-e8f204eb7750]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260]
Aug 15 02:25:07 user nova-compute[73121]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260] successful.
Aug 15 02:25:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04d9785-1766-4582-975f-289003ef4014]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] <== disconnect_volume: return (282ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:25:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:25:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Deleting instance files /opt/stack/data/nova/instances/716adf87-ce49-44dc-9a75-aa84e27899bb_del
Aug 15 02:25:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Deletion of /opt/stack/data/nova/instances/716adf87-ce49-44dc-9a75-aa84e27899bb_del complete
Aug 15 02:25:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-dbd9e962-9983-4303-87af-e866b85289ae req-1250eea2-7876-424d-8a4a-de63bfb9bb2e service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updated VIF entry in instance network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-dbd9e962-9983-4303-87af-e866b85289ae req-1250eea2-7876-424d-8a4a-de63bfb9bb2e service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": null, "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd2e719c6-98", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-dbd9e962-9983-4303-87af-e866b85289ae req-1250eea2-7876-424d-8a4a-de63bfb9bb2e service nova] Releasing lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-6e0024ed-5ee8-4257-89cb-cc3e292670a5 req-747edc98-45f6-4381-98c6-737e85d9c5c8 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6e0024ed-5ee8-4257-89cb-cc3e292670a5 req-747edc98-45f6-4381-98c6-737e85d9c5c8 service nova] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6e0024ed-5ee8-4257-89cb-cc3e292670a5 req-747edc98-45f6-4381-98c6-737e85d9c5c8 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6e0024ed-5ee8-4257-89cb-cc3e292670a5 req-747edc98-45f6-4381-98c6-737e85d9c5c8 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-6e0024ed-5ee8-4257-89cb-cc3e292670a5 req-747edc98-45f6-4381-98c6-737e85d9c5c8 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] No waiting events found dispatching network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:08 user nova-compute[73121]: WARNING nova.compute.manager [req-6e0024ed-5ee8-4257-89cb-cc3e292670a5 req-747edc98-45f6-4381-98c6-737e85d9c5c8 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received unexpected event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 for instance with vm_state active and task_state shelving.
Aug 15 02:25:08 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Deleted allocations for instance 716adf87-ce49-44dc-9a75-aa84e27899bb
Aug 15 02:25:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG nova.objects.instance [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lazy-loading 'numa_topology' on Instance uuid 716adf87-ce49-44dc-9a75-aa84e27899bb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:08 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:25:09 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:25:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-317eea1d-f956-4695-b475-1f75478d6bfd tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.756s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:15 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066300.5559714, 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:25:15 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] VM Stopped (Lifecycle Event)
Aug 15 02:25:15 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e528edaa-9722-49b1-92f6-ed94632e71da None None] [instance: 1cdacf7e-1d4d-4e58-857a-f70a0bf84d17] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:25:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:21 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066306.0788274, 716adf87-ce49-44dc-9a75-aa84e27899bb => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:25:21 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] VM Stopped (Lifecycle Event)
Aug 15 02:25:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a9775acc-8d39-451a-8ea6-5f0372d74ec5 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:25:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:30 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:25:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:25:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:25:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:25:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:25:33 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:25:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:25:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:36 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updating instance_info_cache with network_info: [{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:39 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:25:39 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:25:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8361MB free_disk=25.32599639892578GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:25:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:25:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:25:47 user nova-compute[73121]: INFO nova.compute.claims [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Claim successful on node user
Aug 15 02:25:47 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:25:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:25:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:25:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Creating image(s)
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "/opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "/opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG nova.policy [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88947c21cb5b4c41969a408f949666c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e42e645406e44a9286cfb543f9d30064', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk 1073741824" returned: 0 in 0.060s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:25:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Successfully created port: 73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Cannot resize image /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'migration_context' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Ensure instance console log exists: /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:49 user nova-compute[73121]: INFO nova.compute.manager [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Rescuing
Aug 15 02:25:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquired lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:25:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Successfully updated port: 73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-1db72dda-1f83-4d6b-b021-87c94e6b024d req-689a6f6f-21eb-488e-bc5e-f2c9747e582b service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-changed-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-1db72dda-1f83-4d6b-b021-87c94e6b024d req-689a6f6f-21eb-488e-bc5e-f2c9747e582b service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Refreshing instance network info cache due to event network-changed-73961bb4-e1a8-481e-9883-9dbe008a55d9. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1db72dda-1f83-4d6b-b021-87c94e6b024d req-689a6f6f-21eb-488e-bc5e-f2c9747e582b service nova] Acquiring lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1db72dda-1f83-4d6b-b021-87c94e6b024d req-689a6f6f-21eb-488e-bc5e-f2c9747e582b service nova] Acquired lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-1db72dda-1f83-4d6b-b021-87c94e6b024d req-689a6f6f-21eb-488e-bc5e-f2c9747e582b service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Refreshing network info cache for port 73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG nova.network.neutron [req-1db72dda-1f83-4d6b-b021-87c94e6b024d req-689a6f6f-21eb-488e-bc5e-f2c9747e582b service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updating instance_info_cache with network_info: [{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Releasing lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-1db72dda-1f83-4d6b-b021-87c94e6b024d req-689a6f6f-21eb-488e-bc5e-f2c9747e582b service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1db72dda-1f83-4d6b-b021-87c94e6b024d req-689a6f6f-21eb-488e-bc5e-f2c9747e582b service nova] Releasing lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquired lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:25:51 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Instance destroyed successfully.
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:25:51 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Attempting rescue
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73121) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Instance directory exists: not creating {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 02:25:51 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Creating image(s)
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-3da1ba07-a6e2-4a57-b74d-d0d4b561a9e7 req-0e6bfdf5-0864-47a2-bf68-ed9bcc2335b6 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-unplugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3da1ba07-a6e2-4a57-b74d-d0d4b561a9e7 req-0e6bfdf5-0864-47a2-bf68-ed9bcc2335b6 service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3da1ba07-a6e2-4a57-b74d-d0d4b561a9e7 req-0e6bfdf5-0864-47a2-bf68-ed9bcc2335b6 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3da1ba07-a6e2-4a57-b74d-d0d4b561a9e7 req-0e6bfdf5-0864-47a2-bf68-ed9bcc2335b6 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-3da1ba07-a6e2-4a57-b74d-d0d4b561a9e7 req-0e6bfdf5-0864-47a2-bf68-ed9bcc2335b6 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-unplugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:51 user nova-compute[73121]: WARNING nova.compute.manager [req-3da1ba07-a6e2-4a57-b74d-d0d4b561a9e7 req-0e6bfdf5-0864-47a2-bf68-ed9bcc2335b6 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-unplugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state active and task_state rescuing.
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.299s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue" returned: 0 in 0.060s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'migration_context' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Start _get_guest_xml network_info=[{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "vif_mac": "fa:16:3e:bc:b9:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'resources' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'numa_topology' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:25:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1658867354',display_name='tempest-ServerRescueNegativeTestJSON-server-1658867354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1658867354',id=42,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:21:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-9i9zxafu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:21:13Z,user_data=None,user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=6ecfcc84-d915-4eac-bbf6-9ab2b5782088,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "vif_mac": "fa:16:3e:bc:b9:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "vif_mac": "fa:16:3e:bc:b9:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b9:e2,bridge_name='br-int',has_traffic_filtering=True,id=db197fcc-d147-49fa-9c46-9f330534c0e6,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb197fcc-d1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:25:51 user nova-compute[73121]:   <uuid>6ecfcc84-d915-4eac-bbf6-9ab2b5782088</uuid>
Aug 15 02:25:51 user nova-compute[73121]:   <name>instance-0000002a</name>
Aug 15 02:25:51 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:25:51 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:25:51 user nova-compute[73121]:   <metadata>
Aug 15 02:25:51 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:25:51 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:25:51 user nova-compute[73121]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1658867354</nova:name>
Aug 15 02:25:51 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:25:51</nova:creationTime>
Aug 15 02:25:51 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:25:51 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:25:51 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:25:51 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:25:51 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:25:51 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:25:51 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:25:51 user nova-compute[73121]:       <nova:owner>
Aug 15 02:25:51 user nova-compute[73121]:         <nova:user uuid="c5012859ad374ac0b441cc5a5739cf4e">tempest-ServerRescueNegativeTestJSON-704093322-project-member</nova:user>
Aug 15 02:25:51 user nova-compute[73121]:         <nova:project uuid="c202114f5c584284a72d52cececc4b34">tempest-ServerRescueNegativeTestJSON-704093322</nova:project>
Aug 15 02:25:51 user nova-compute[73121]:       </nova:owner>
Aug 15 02:25:51 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:25:51 user nova-compute[73121]:       <nova:ports>
Aug 15 02:25:51 user nova-compute[73121]:         <nova:port uuid="db197fcc-d147-49fa-9c46-9f330534c0e6">
Aug 15 02:25:51 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:25:51 user nova-compute[73121]:         </nova:port>
Aug 15 02:25:51 user nova-compute[73121]:       </nova:ports>
Aug 15 02:25:51 user nova-compute[73121]:     </nova:instance>
Aug 15 02:25:51 user nova-compute[73121]:   </metadata>
Aug 15 02:25:51 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:25:51 user nova-compute[73121]:     <system>
Aug 15 02:25:51 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:25:51 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:25:51 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:25:51 user nova-compute[73121]:       <entry name="serial">6ecfcc84-d915-4eac-bbf6-9ab2b5782088</entry>
Aug 15 02:25:51 user nova-compute[73121]:       <entry name="uuid">6ecfcc84-d915-4eac-bbf6-9ab2b5782088</entry>
Aug 15 02:25:51 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:25:51 user nova-compute[73121]:     </system>
Aug 15 02:25:51 user nova-compute[73121]:   </sysinfo>
Aug 15 02:25:51 user nova-compute[73121]:   <os>
Aug 15 02:25:51 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:25:51 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:25:51 user nova-compute[73121]:   </os>
Aug 15 02:25:51 user nova-compute[73121]:   <features>
Aug 15 02:25:51 user nova-compute[73121]:     <acpi/>
Aug 15 02:25:51 user nova-compute[73121]:     <apic/>
Aug 15 02:25:51 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:25:51 user nova-compute[73121]:   </features>
Aug 15 02:25:51 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:25:51 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:25:51 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:25:51 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:25:51 user nova-compute[73121]:   </clock>
Aug 15 02:25:51 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:25:51 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:25:51 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:25:51 user nova-compute[73121]:   </cpu>
Aug 15 02:25:51 user nova-compute[73121]:   <devices>
Aug 15 02:25:51 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:25:51 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:25:51 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue"/>
Aug 15 02:25:51 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:25:51 user nova-compute[73121]:     </disk>
Aug 15 02:25:51 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:25:51 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:25:51 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk"/>
Aug 15 02:25:51 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:25:51 user nova-compute[73121]:     </disk>
Aug 15 02:25:51 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:25:51 user nova-compute[73121]:       <mac address="fa:16:3e:bc:b9:e2"/>
Aug 15 02:25:51 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:25:51 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:25:51 user nova-compute[73121]:       <target dev="tapdb197fcc-d1"/>
Aug 15 02:25:51 user nova-compute[73121]:     </interface>
Aug 15 02:25:51 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:25:51 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/console.log" append="off"/>
Aug 15 02:25:51 user nova-compute[73121]:     </serial>
Aug 15 02:25:51 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:25:51 user nova-compute[73121]:     <video>
Aug 15 02:25:51 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:25:51 user nova-compute[73121]:     </video>
Aug 15 02:25:51 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:25:51 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:25:51 user nova-compute[73121]:     </rng>
Aug 15 02:25:51 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:25:51 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:25:51 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:25:51 user nova-compute[73121]:     </memballoon>
Aug 15 02:25:51 user nova-compute[73121]:   </devices>
Aug 15 02:25:51 user nova-compute[73121]: </domain>
Aug 15 02:25:51 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:25:51 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Instance destroyed successfully.
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:25:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No VIF found with MAC fa:16:3e:bc:b9:e2, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.network.neutron [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Releasing lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance network_info: |[{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Start _get_guest_xml network_info=[{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:25:52 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:25:52 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949422126',display_name='tempest-ServerActionsTestOtherB-server-949422126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949422126',id=47,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHtT/z4+EwvsQypxm7gdMPNSlReNYTbUu3hKKgnLffbACwld+psBjNbQUUl3fZeJ92B3U1PN95LB9d30L8XORPoR9Kn5sBYGKVZpr0ZJgl63wFEoFNzSdCWjJwXJdBIRA==',key_name='tempest-keypair-1894281607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e42e645406e44a9286cfb543f9d30064',ramdisk_id='',reservation_id='r-pxwx7fmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1222409128',owner_user_name='tempest-ServerActionsTestOtherB-1222409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88947c21cb5b4c41969a408f949666c4',uuid=a8f1af9c-f6d1-4840-bf52-ba2526c558b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converting VIF {"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'pci_devices' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:25:52 user nova-compute[73121]:   <uuid>a8f1af9c-f6d1-4840-bf52-ba2526c558b0</uuid>
Aug 15 02:25:52 user nova-compute[73121]:   <name>instance-0000002f</name>
Aug 15 02:25:52 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:25:52 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:25:52 user nova-compute[73121]:   <metadata>
Aug 15 02:25:52 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:25:52 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:25:52 user nova-compute[73121]:       <nova:name>tempest-ServerActionsTestOtherB-server-949422126</nova:name>
Aug 15 02:25:52 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:25:52</nova:creationTime>
Aug 15 02:25:52 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:25:52 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:25:52 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:25:52 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:25:52 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:25:52 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:25:52 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:25:52 user nova-compute[73121]:       <nova:owner>
Aug 15 02:25:52 user nova-compute[73121]:         <nova:user uuid="88947c21cb5b4c41969a408f949666c4">tempest-ServerActionsTestOtherB-1222409128-project-member</nova:user>
Aug 15 02:25:52 user nova-compute[73121]:         <nova:project uuid="e42e645406e44a9286cfb543f9d30064">tempest-ServerActionsTestOtherB-1222409128</nova:project>
Aug 15 02:25:52 user nova-compute[73121]:       </nova:owner>
Aug 15 02:25:52 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:25:52 user nova-compute[73121]:       <nova:ports>
Aug 15 02:25:52 user nova-compute[73121]:         <nova:port uuid="73961bb4-e1a8-481e-9883-9dbe008a55d9">
Aug 15 02:25:52 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 02:25:52 user nova-compute[73121]:         </nova:port>
Aug 15 02:25:52 user nova-compute[73121]:       </nova:ports>
Aug 15 02:25:52 user nova-compute[73121]:     </nova:instance>
Aug 15 02:25:52 user nova-compute[73121]:   </metadata>
Aug 15 02:25:52 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:25:52 user nova-compute[73121]:     <system>
Aug 15 02:25:52 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:25:52 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:25:52 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:25:52 user nova-compute[73121]:       <entry name="serial">a8f1af9c-f6d1-4840-bf52-ba2526c558b0</entry>
Aug 15 02:25:52 user nova-compute[73121]:       <entry name="uuid">a8f1af9c-f6d1-4840-bf52-ba2526c558b0</entry>
Aug 15 02:25:52 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:25:52 user nova-compute[73121]:     </system>
Aug 15 02:25:52 user nova-compute[73121]:   </sysinfo>
Aug 15 02:25:52 user nova-compute[73121]:   <os>
Aug 15 02:25:52 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:25:52 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:25:52 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:25:52 user nova-compute[73121]:   </os>
Aug 15 02:25:52 user nova-compute[73121]:   <features>
Aug 15 02:25:52 user nova-compute[73121]:     <acpi/>
Aug 15 02:25:52 user nova-compute[73121]:     <apic/>
Aug 15 02:25:52 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:25:52 user nova-compute[73121]:   </features>
Aug 15 02:25:52 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:25:52 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:25:52 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:25:52 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:25:52 user nova-compute[73121]:   </clock>
Aug 15 02:25:52 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:25:52 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:25:52 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:25:52 user nova-compute[73121]:   </cpu>
Aug 15 02:25:52 user nova-compute[73121]:   <devices>
Aug 15 02:25:52 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:25:52 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:25:52 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk"/>
Aug 15 02:25:52 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:25:52 user nova-compute[73121]:     </disk>
Aug 15 02:25:52 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:25:52 user nova-compute[73121]:       <mac address="fa:16:3e:92:6c:c0"/>
Aug 15 02:25:52 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:25:52 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:25:52 user nova-compute[73121]:       <target dev="tap73961bb4-e1"/>
Aug 15 02:25:52 user nova-compute[73121]:     </interface>
Aug 15 02:25:52 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:25:52 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/console.log" append="off"/>
Aug 15 02:25:52 user nova-compute[73121]:     </serial>
Aug 15 02:25:52 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:25:52 user nova-compute[73121]:     <video>
Aug 15 02:25:52 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:25:52 user nova-compute[73121]:     </video>
Aug 15 02:25:52 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:25:52 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:25:52 user nova-compute[73121]:     </rng>
Aug 15 02:25:52 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:25:52 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:25:52 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:25:52 user nova-compute[73121]:     </memballoon>
Aug 15 02:25:52 user nova-compute[73121]:   </devices>
Aug 15 02:25:52 user nova-compute[73121]: </domain>
Aug 15 02:25:52 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949422126',display_name='tempest-ServerActionsTestOtherB-server-949422126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949422126',id=47,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHtT/z4+EwvsQypxm7gdMPNSlReNYTbUu3hKKgnLffbACwld+psBjNbQUUl3fZeJ92B3U1PN95LB9d30L8XORPoR9Kn5sBYGKVZpr0ZJgl63wFEoFNzSdCWjJwXJdBIRA==',key_name='tempest-keypair-1894281607',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e42e645406e44a9286cfb543f9d30064',ramdisk_id='',reservation_id='r-pxwx7fmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1222409128',owner_user_name='tempest-ServerActionsTestOtherB-1222409128-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:25:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88947c21cb5b4c41969a408f949666c4',uuid=a8f1af9c-f6d1-4840-bf52-ba2526c558b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converting VIF {"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG os_vif [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73961bb4-e1, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73961bb4-e1, col_values=(('external_ids', {'iface-id': '73961bb4-e1a8-481e-9883-9dbe008a55d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:6c:c0', 'vm-uuid': 'a8f1af9c-f6d1-4840-bf52-ba2526c558b0'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:52 user nova-compute[73121]: INFO os_vif [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1')
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] No VIF found with MAC fa:16:3e:92:6c:c0, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:25:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-0c422cbe-695d-4b3b-beeb-1035a78122f7 req-427a0380-a34b-4261-a9e0-db5e1ba4b5b2 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0c422cbe-695d-4b3b-beeb-1035a78122f7 req-427a0380-a34b-4261-a9e0-db5e1ba4b5b2 service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0c422cbe-695d-4b3b-beeb-1035a78122f7 req-427a0380-a34b-4261-a9e0-db5e1ba4b5b2 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0c422cbe-695d-4b3b-beeb-1035a78122f7 req-427a0380-a34b-4261-a9e0-db5e1ba4b5b2 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:53 user nova-compute[73121]: DEBUG nova.compute.manager [req-0c422cbe-695d-4b3b-beeb-1035a78122f7 req-427a0380-a34b-4261-a9e0-db5e1ba4b5b2 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:53 user nova-compute[73121]: WARNING nova.compute.manager [req-0c422cbe-695d-4b3b-beeb-1035a78122f7 req-427a0380-a34b-4261-a9e0-db5e1ba4b5b2 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state active and task_state rescuing.
Aug 15 02:25:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-6e871963-92ce-4a0c-9196-2ca76cded7b7 req-96ac39fd-9384-4889-a8c0-59ff93868d32 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6e871963-92ce-4a0c-9196-2ca76cded7b7 req-96ac39fd-9384-4889-a8c0-59ff93868d32 service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6e871963-92ce-4a0c-9196-2ca76cded7b7 req-96ac39fd-9384-4889-a8c0-59ff93868d32 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6e871963-92ce-4a0c-9196-2ca76cded7b7 req-96ac39fd-9384-4889-a8c0-59ff93868d32 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-6e871963-92ce-4a0c-9196-2ca76cded7b7 req-96ac39fd-9384-4889-a8c0-59ff93868d32 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:54 user nova-compute[73121]: WARNING nova.compute.manager [req-6e871963-92ce-4a0c-9196-2ca76cded7b7 req-96ac39fd-9384-4889-a8c0-59ff93868d32 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state building and task_state spawning.
Aug 15 02:25:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:55 user nova-compute[73121]: WARNING nova.compute.manager [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state active and task_state rescuing.
Aug 15 02:25:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:55 user nova-compute[73121]: WARNING nova.compute.manager [req-6b1e947a-c7ca-4b24-bd4b-54e708bb4378 req-6c4c6df9-31d0-45da-81f4-81175b602957 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state active and task_state rescuing.
Aug 15 02:25:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-843a8365-b865-4ea2-9fe2-5d7dca8beb31 req-78b5ecfc-f7fc-4683-a88b-24a6972a358d service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-843a8365-b865-4ea2-9fe2-5d7dca8beb31 req-78b5ecfc-f7fc-4683-a88b-24a6972a358d service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:25:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-843a8365-b865-4ea2-9fe2-5d7dca8beb31 req-78b5ecfc-f7fc-4683-a88b-24a6972a358d service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:25:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-843a8365-b865-4ea2-9fe2-5d7dca8beb31 req-78b5ecfc-f7fc-4683-a88b-24a6972a358d service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:56 user nova-compute[73121]: DEBUG nova.compute.manager [req-843a8365-b865-4ea2-9fe2-5d7dca8beb31 req-78b5ecfc-f7fc-4683-a88b-24a6972a358d service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:25:56 user nova-compute[73121]: WARNING nova.compute.manager [req-843a8365-b865-4ea2-9fe2-5d7dca8beb31 req-78b5ecfc-f7fc-4683-a88b-24a6972a358d service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state building and task_state spawning.
Aug 15 02:25:56 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:25:56 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066356.9796095, 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:25:56 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] VM Resumed (Lifecycle Event)
Aug 15 02:25:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-14931684-9b34-422f-b30a-83fc44dc942f tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066356.9813452, 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] VM Started (Lifecycle Event)
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance spawned successfully.
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066357.090956, a8f1af9c-f6d1-4840-bf52-ba2526c558b0 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] VM Resumed (Lifecycle Event)
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066357.0918238, a8f1af9c-f6d1-4840-bf52-ba2526c558b0 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] VM Started (Lifecycle Event)
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Took 9.05 seconds to spawn the instance on the hypervisor.
Aug 15 02:25:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:25:57 user nova-compute[73121]: INFO nova.compute.manager [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Took 9.72 seconds to build instance.
Aug 15 02:25:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c29bcdea-58af-43a4-b6c5-38d482bfebbd tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.823s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:25:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:25:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-e1978ac8-3564-4408-9602-66dbc56c1f35 req-a53be2f2-941c-47fa-aaef-1020b8a69e6f service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-changed-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:25:59 user nova-compute[73121]: DEBUG nova.compute.manager [req-e1978ac8-3564-4408-9602-66dbc56c1f35 req-a53be2f2-941c-47fa-aaef-1020b8a69e6f service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Refreshing instance network info cache due to event network-changed-2225348a-2bc9-438d-810a-9702d8bc4cfe. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:25:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e1978ac8-3564-4408-9602-66dbc56c1f35 req-a53be2f2-941c-47fa-aaef-1020b8a69e6f service nova] Acquiring lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:25:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e1978ac8-3564-4408-9602-66dbc56c1f35 req-a53be2f2-941c-47fa-aaef-1020b8a69e6f service nova] Acquired lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:25:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-e1978ac8-3564-4408-9602-66dbc56c1f35 req-a53be2f2-941c-47fa-aaef-1020b8a69e6f service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Refreshing network info cache for port 2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:26:00 user nova-compute[73121]: DEBUG nova.network.neutron [req-e1978ac8-3564-4408-9602-66dbc56c1f35 req-a53be2f2-941c-47fa-aaef-1020b8a69e6f service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updated VIF entry in instance network info cache for port 2225348a-2bc9-438d-810a-9702d8bc4cfe. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:26:00 user nova-compute[73121]: DEBUG nova.network.neutron [req-e1978ac8-3564-4408-9602-66dbc56c1f35 req-a53be2f2-941c-47fa-aaef-1020b8a69e6f service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updating instance_info_cache with network_info: [{"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:26:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e1978ac8-3564-4408-9602-66dbc56c1f35 req-a53be2f2-941c-47fa-aaef-1020b8a69e6f service nova] Releasing lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:26:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:26:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:26:04 user nova-compute[73121]: INFO nova.compute.manager [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Shelving
Aug 15 02:26:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-aadfacf6-1e41-43bf-8e9a-755dbb380725 req-c5a66268-406e-4cbd-8b9f-490ed5218f3f service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-unplugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:26:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-aadfacf6-1e41-43bf-8e9a-755dbb380725 req-c5a66268-406e-4cbd-8b9f-490ed5218f3f service nova] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:26:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-aadfacf6-1e41-43bf-8e9a-755dbb380725 req-c5a66268-406e-4cbd-8b9f-490ed5218f3f service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:26:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-aadfacf6-1e41-43bf-8e9a-755dbb380725 req-c5a66268-406e-4cbd-8b9f-490ed5218f3f service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:26:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-aadfacf6-1e41-43bf-8e9a-755dbb380725 req-c5a66268-406e-4cbd-8b9f-490ed5218f3f service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] No waiting events found dispatching network-vif-unplugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:26:05 user nova-compute[73121]: WARNING nova.compute.manager [req-aadfacf6-1e41-43bf-8e9a-755dbb380725 req-c5a66268-406e-4cbd-8b9f-490ed5218f3f service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received unexpected event network-vif-unplugged-2225348a-2bc9-438d-810a-9702d8bc4cfe for instance with vm_state active and task_state shelving.
Aug 15 02:26:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:05 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance destroyed successfully.
Aug 15 02:26:05 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Beginning cold snapshot process
Aug 15 02:26:05 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:26:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk /opt/stack/data/nova/instances/snapshots/tmplkt05hew/dcc8bed17c834a24b0ff816a1d71f3f4 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk /opt/stack/data/nova/instances/snapshots/tmplkt05hew/dcc8bed17c834a24b0ff816a1d71f3f4" returned: 0 in 0.872s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Snapshot extracted, beginning image upload
Aug 15 02:26:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-0baae8b2-6f69-4df9-9cea-28208097ea41 req-55f8c42a-bdb1-4430-a3b3-3583b385332b service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:26:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0baae8b2-6f69-4df9-9cea-28208097ea41 req-55f8c42a-bdb1-4430-a3b3-3583b385332b service nova] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:26:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0baae8b2-6f69-4df9-9cea-28208097ea41 req-55f8c42a-bdb1-4430-a3b3-3583b385332b service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:26:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0baae8b2-6f69-4df9-9cea-28208097ea41 req-55f8c42a-bdb1-4430-a3b3-3583b385332b service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:26:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-0baae8b2-6f69-4df9-9cea-28208097ea41 req-55f8c42a-bdb1-4430-a3b3-3583b385332b service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] No waiting events found dispatching network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:26:07 user nova-compute[73121]: WARNING nova.compute.manager [req-0baae8b2-6f69-4df9-9cea-28208097ea41 req-55f8c42a-bdb1-4430-a3b3-3583b385332b service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received unexpected event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 02:26:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:09 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Snapshot image upload complete
Aug 15 02:26:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:26:10 user nova-compute[73121]: INFO nova.compute.manager [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Shelve offloading
Aug 15 02:26:10 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance destroyed successfully.
Aug 15 02:26:10 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:26:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:26:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquired lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:26:10 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:26:10 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updating instance_info_cache with network_info: [{"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:26:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Releasing lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:26:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance destroyed successfully.
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'resources' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:24:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1573016178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1573016178',id=46,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0CybmE9myuAGhYvCYfuBxDAuo6u0/SHZffq95vLxhi23l3anIGFkGaWmCRHH5OlrGTkqQR2IC8QlJhrL9PLUl24i6sCHujzNc9h3kZfqSh+4Yem/ymmndCH/2pT8Nk5Q==',key_name='tempest-keypair-742960521',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-wwtuzahc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member',shelved_at='2023-08-15T02:26:09.944032',shelved_host='user',shelved_image_id='9a610846-0932-4c24-aecb-a8ea8b0cd367'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:26:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG os_vif [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2225348a-2b, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-8ceda49b-c36e-4d68-a6df-4d06e95738ef req-138c3080-8db7-43ff-9dbb-6688c5e8a7e2 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-changed-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-8ceda49b-c36e-4d68-a6df-4d06e95738ef req-138c3080-8db7-43ff-9dbb-6688c5e8a7e2 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Refreshing instance network info cache due to event network-changed-2225348a-2bc9-438d-810a-9702d8bc4cfe. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8ceda49b-c36e-4d68-a6df-4d06e95738ef req-138c3080-8db7-43ff-9dbb-6688c5e8a7e2 service nova] Acquiring lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8ceda49b-c36e-4d68-a6df-4d06e95738ef req-138c3080-8db7-43ff-9dbb-6688c5e8a7e2 service nova] Acquired lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.network.neutron [req-8ceda49b-c36e-4d68-a6df-4d06e95738ef req-138c3080-8db7-43ff-9dbb-6688c5e8a7e2 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Refreshing network info cache for port 2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:11 user nova-compute[73121]: INFO os_vif [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b')
Aug 15 02:26:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Deleting instance files /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f_del
Aug 15 02:26:11 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Deletion of /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f_del complete
Aug 15 02:26:11 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Deleted allocations for instance ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f
Aug 15 02:26:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'numa_topology' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffd956e4-6f26-49ec-9754-d743a5523442 tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.094s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.network.neutron [req-8ceda49b-c36e-4d68-a6df-4d06e95738ef req-138c3080-8db7-43ff-9dbb-6688c5e8a7e2 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updated VIF entry in instance network info cache for port 2225348a-2bc9-438d-810a-9702d8bc4cfe. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG nova.network.neutron [req-8ceda49b-c36e-4d68-a6df-4d06e95738ef req-138c3080-8db7-43ff-9dbb-6688c5e8a7e2 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updating instance_info_cache with network_info: [{"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2225348a-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:26:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8ceda49b-c36e-4d68-a6df-4d06e95738ef req-138c3080-8db7-43ff-9dbb-6688c5e8a7e2 service nova] Releasing lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:26:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:20 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066365.6652265, ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:26:20 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] VM Stopped (Lifecycle Event)
Aug 15 02:26:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ecf8aff4-b0aa-4a51-8896-1c1a747a44a9 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:26:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:31 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:33 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:33 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:34 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:26:36 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:38 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:39 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:26:39 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8264MB free_disk=25.264476776123047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:26:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updating instance_info_cache with network_info: [{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:26:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:26:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:26:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:26:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:26:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:26:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:26:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:26:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:47 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:26:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:26:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:26:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:26:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:26:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:26:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:26:57 user nova-compute[73121]: INFO nova.compute.manager [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Unshelving
Aug 15 02:26:57 user nova-compute[73121]: INFO nova.virt.block_device [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Booting with volume ab6e7dff-15a6-49c9-9849-ea840151270d at /dev/vda
Aug 15 02:26:57 user nova-compute[73121]: DEBUG os_brick.utils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[becf0f61-fa4c-4f50-a361-9015d95bc441]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d38727-ad66-41e7-a0de-152c1a833336]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe73e2ac-24b1-4f7d-84fa-ffb818fc94b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef177008-d389-4166-a696-263ec450d473]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:26:57 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:26:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27731c7-750a-4459-a052-8fc16c18e543]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG os_brick.utils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:26:57 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating existing volume attachment record: 28e3bf25-caca-4361-8a63-e160e47afd04 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:27:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:27:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:06 user nova-compute[73121]: DEBUG nova.objects.instance [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lazy-loading 'pci_requests' on Instance uuid 716adf87-ce49-44dc-9a75-aa84e27899bb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:27:06 user nova-compute[73121]: DEBUG nova.objects.instance [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lazy-loading 'numa_topology' on Instance uuid 716adf87-ce49-44dc-9a75-aa84e27899bb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:27:06 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:27:06 user nova-compute[73121]: INFO nova.compute.claims [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Claim successful on node user
Aug 15 02:27:06 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:27:06 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:27:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.295s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:06 user nova-compute[73121]: INFO nova.network.neutron [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating port d2e719c6-982b-4d93-a266-8a0dfe7775f6 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 02:27:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:27:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquired lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:27:07 user nova-compute[73121]: DEBUG nova.network.neutron [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:27:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-f33977d8-825d-4963-a22d-b3e7256139fa req-c1f643c2-258a-4182-9bfc-a8f33e325475 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-f33977d8-825d-4963-a22d-b3e7256139fa req-c1f643c2-258a-4182-9bfc-a8f33e325475 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing instance network info cache due to event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:27:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f33977d8-825d-4963-a22d-b3e7256139fa req-c1f643c2-258a-4182-9bfc-a8f33e325475 service nova] Acquiring lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.network.neutron [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Releasing lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:27:08 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Creating image(s)
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Ensure instance console log exists: /opt/stack/data/nova/instances/716adf87-ce49-44dc-9a75-aa84e27899bb/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Start _get_guest_xml network_info=[{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'boot_index': 0, 'delete_on_termination': True, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '28e3bf25-caca-4361-8a63-e160e47afd04', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUCHucVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '716adf87-ce49-44dc-9a75-aa84e27899bb', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab6e7dff-15a6-49c9-9849-ea840151270d', 'serial': 'ab6e7dff-15a6-49c9-9849-ea840151270d'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f33977d8-825d-4963-a22d-b3e7256139fa req-c1f643c2-258a-4182-9bfc-a8f33e325475 service nova] Acquired lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-f33977d8-825d-4963-a22d-b3e7256139fa req-c1f643c2-258a-4182-9bfc-a8f33e325475 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:27:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:27:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.objects.instance [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 716adf87-ce49-44dc-9a75-aa84e27899bb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUCHucVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:27:08 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:27:08 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:27:08 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e0dda3-1635-421f-b47a-1ad112e682e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:27:08 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09f246e-3f18-444e-91fc-bf36443a8823]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d] added
Aug 15 02:27:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca162dc-0a67-498d-ad99-6292478f340f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be4f3a9-22b2-496b-8a65-4dd8a8f14618]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUCHucVO {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUCHucVO" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[509b1ba3-a37d-4949-a956-16b0235032ef]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUCHucVO'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cddcad07-68bf-4b96-9cfb-27cb3d19d9aa]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62708d6-8bb9-42ac-bc3a-9fb165a75424]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:27:08 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:27:08 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:27:08 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:27:08 user nova-compute[73121]: 
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d87d5ef-b5e6-40cf-bca7-f27917b9b076]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260]
Aug 15 02:27:08 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260] successful.
Aug 15 02:27:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b8be13-2787-4e3b-9fd1-7091b5228bac]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d3398d-52b4-4acf-add5-02d7842122e0]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:27:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:27:08 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac3bf5-6968-40a8-ab29-ab8bf064c9fe]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUCHucVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-f33977d8-825d-4963-a22d-b3e7256139fa req-c1f643c2-258a-4182-9bfc-a8f33e325475 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updated VIF entry in instance network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG nova.network.neutron [req-f33977d8-825d-4963-a22d-b3e7256139fa req-c1f643c2-258a-4182-9bfc-a8f33e325475 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:27:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f33977d8-825d-4963-a22d-b3e7256139fa req-c1f643c2-258a-4182-9bfc-a8f33e325475 service nova] Releasing lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23534323264663138', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534323264663138', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081680432',display_name='tempest-TestShelveInstance-server-2081680432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081680432',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-280997968',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:23:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='810dbe4d00334869a75c7307a19e46e5',ramdisk_id='',reservation_id='r-r9mfxb04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1123354322',owner_user_name='tempest-TestShelveInstance-1123354322-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:26:58Z,user_data=None,user_id='70f546300273431c8f3d51b8a828be22',uuid=716adf87-ce49-44dc-9a75-aa84e27899bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converting VIF {"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.objects.instance [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lazy-loading 'pci_devices' on Instance uuid 716adf87-ce49-44dc-9a75-aa84e27899bb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:27:09 user nova-compute[73121]:   <uuid>716adf87-ce49-44dc-9a75-aa84e27899bb</uuid>
Aug 15 02:27:09 user nova-compute[73121]:   <name>instance-0000002d</name>
Aug 15 02:27:09 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:27:09 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:27:09 user nova-compute[73121]:   <metadata>
Aug 15 02:27:09 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:27:09 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:27:09 user nova-compute[73121]:       <nova:name>tempest-TestShelveInstance-server-2081680432</nova:name>
Aug 15 02:27:09 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:27:08</nova:creationTime>
Aug 15 02:27:09 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:27:09 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:27:09 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:27:09 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:27:09 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:27:09 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:27:09 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:27:09 user nova-compute[73121]:       <nova:owner>
Aug 15 02:27:09 user nova-compute[73121]:         <nova:user uuid="70f546300273431c8f3d51b8a828be22">tempest-TestShelveInstance-1123354322-project-member</nova:user>
Aug 15 02:27:09 user nova-compute[73121]:         <nova:project uuid="810dbe4d00334869a75c7307a19e46e5">tempest-TestShelveInstance-1123354322</nova:project>
Aug 15 02:27:09 user nova-compute[73121]:       </nova:owner>
Aug 15 02:27:09 user nova-compute[73121]:       <nova:ports>
Aug 15 02:27:09 user nova-compute[73121]:         <nova:port uuid="d2e719c6-982b-4d93-a266-8a0dfe7775f6">
Aug 15 02:27:09 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:27:09 user nova-compute[73121]:         </nova:port>
Aug 15 02:27:09 user nova-compute[73121]:       </nova:ports>
Aug 15 02:27:09 user nova-compute[73121]:     </nova:instance>
Aug 15 02:27:09 user nova-compute[73121]:   </metadata>
Aug 15 02:27:09 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:27:09 user nova-compute[73121]:     <system>
Aug 15 02:27:09 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:27:09 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:27:09 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:27:09 user nova-compute[73121]:       <entry name="serial">716adf87-ce49-44dc-9a75-aa84e27899bb</entry>
Aug 15 02:27:09 user nova-compute[73121]:       <entry name="uuid">716adf87-ce49-44dc-9a75-aa84e27899bb</entry>
Aug 15 02:27:09 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:27:09 user nova-compute[73121]:     </system>
Aug 15 02:27:09 user nova-compute[73121]:   </sysinfo>
Aug 15 02:27:09 user nova-compute[73121]:   <os>
Aug 15 02:27:09 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:27:09 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:27:09 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:27:09 user nova-compute[73121]:   </os>
Aug 15 02:27:09 user nova-compute[73121]:   <features>
Aug 15 02:27:09 user nova-compute[73121]:     <acpi/>
Aug 15 02:27:09 user nova-compute[73121]:     <apic/>
Aug 15 02:27:09 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:27:09 user nova-compute[73121]:   </features>
Aug 15 02:27:09 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:27:09 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:27:09 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:27:09 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:27:09 user nova-compute[73121]:   </clock>
Aug 15 02:27:09 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:27:09 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:27:09 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:27:09 user nova-compute[73121]:   </cpu>
Aug 15 02:27:09 user nova-compute[73121]:   <devices>
Aug 15 02:27:09 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:27:09 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:27:09 user nova-compute[73121]:       <source dev="/dev/sdb"/>
Aug 15 02:27:09 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:27:09 user nova-compute[73121]:       <serial>ab6e7dff-15a6-49c9-9849-ea840151270d</serial>
Aug 15 02:27:09 user nova-compute[73121]:     </disk>
Aug 15 02:27:09 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:27:09 user nova-compute[73121]:       <mac address="fa:16:3e:f4:9d:1b"/>
Aug 15 02:27:09 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:27:09 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:27:09 user nova-compute[73121]:       <target dev="tapd2e719c6-98"/>
Aug 15 02:27:09 user nova-compute[73121]:     </interface>
Aug 15 02:27:09 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:27:09 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/716adf87-ce49-44dc-9a75-aa84e27899bb/console.log" append="off"/>
Aug 15 02:27:09 user nova-compute[73121]:     </serial>
Aug 15 02:27:09 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:27:09 user nova-compute[73121]:     <video>
Aug 15 02:27:09 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:27:09 user nova-compute[73121]:     </video>
Aug 15 02:27:09 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:27:09 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:27:09 user nova-compute[73121]:     </rng>
Aug 15 02:27:09 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:27:09 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:27:09 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:27:09 user nova-compute[73121]:     </memballoon>
Aug 15 02:27:09 user nova-compute[73121]:   </devices>
Aug 15 02:27:09 user nova-compute[73121]: </domain>
Aug 15 02:27:09 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081680432',display_name='tempest-TestShelveInstance-server-2081680432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081680432',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-280997968',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:23:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='810dbe4d00334869a75c7307a19e46e5',ramdisk_id='',reservation_id='r-r9mfxb04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1123354322',owner_user_name='tempest-TestShelveInstance-1123354322-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:26:58Z,user_data=None,user_id='70f546300273431c8f3d51b8a828be22',uuid=716adf87-ce49-44dc-9a75-aa84e27899bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converting VIF {"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG os_vif [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2e719c6-98, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2e719c6-98, col_values=(('external_ids', {'iface-id': 'd2e719c6-982b-4d93-a266-8a0dfe7775f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:9d:1b', 'vm-uuid': '716adf87-ce49-44dc-9a75-aa84e27899bb'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:09 user nova-compute[73121]: INFO os_vif [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98')
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:27:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] No VIF found with MAC fa:16:3e:f4:9d:1b, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:27:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-0f341365-b734-417b-9af8-399cdb88912e req-2dc3c9e6-731d-4a1f-92f0-8d6ac1c9f162 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0f341365-b734-417b-9af8-399cdb88912e req-2dc3c9e6-731d-4a1f-92f0-8d6ac1c9f162 service nova] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0f341365-b734-417b-9af8-399cdb88912e req-2dc3c9e6-731d-4a1f-92f0-8d6ac1c9f162 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0f341365-b734-417b-9af8-399cdb88912e req-2dc3c9e6-731d-4a1f-92f0-8d6ac1c9f162 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:11 user nova-compute[73121]: DEBUG nova.compute.manager [req-0f341365-b734-417b-9af8-399cdb88912e req-2dc3c9e6-731d-4a1f-92f0-8d6ac1c9f162 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] No waiting events found dispatching network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:11 user nova-compute[73121]: WARNING nova.compute.manager [req-0f341365-b734-417b-9af8-399cdb88912e req-2dc3c9e6-731d-4a1f-92f0-8d6ac1c9f162 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received unexpected event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 02:27:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 716adf87-ce49-44dc-9a75-aa84e27899bb {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066433.088413, 716adf87-ce49-44dc-9a75-aa84e27899bb => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:27:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] VM Resumed (Lifecycle Event)
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:27:13 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Instance spawned successfully.
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:27:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066433.0896716, 716adf87-ce49-44dc-9a75-aa84e27899bb => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:27:13 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] VM Started (Lifecycle Event)
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-376ce907-4c92-4f1b-af6d-d89ca9ac79fe tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.506s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.512s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:13 user nova-compute[73121]: INFO nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:27:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.009s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6cba4ca-19b0-4ec2-9976-0a2cb8522121 req-7a18fc9e-246a-45e6-9049-21a06070a7f7 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6cba4ca-19b0-4ec2-9976-0a2cb8522121 req-7a18fc9e-246a-45e6-9049-21a06070a7f7 service nova] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6cba4ca-19b0-4ec2-9976-0a2cb8522121 req-7a18fc9e-246a-45e6-9049-21a06070a7f7 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e6cba4ca-19b0-4ec2-9976-0a2cb8522121 req-7a18fc9e-246a-45e6-9049-21a06070a7f7 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:13 user nova-compute[73121]: DEBUG nova.compute.manager [req-e6cba4ca-19b0-4ec2-9976-0a2cb8522121 req-7a18fc9e-246a-45e6-9049-21a06070a7f7 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] No waiting events found dispatching network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:13 user nova-compute[73121]: WARNING nova.compute.manager [req-e6cba4ca-19b0-4ec2-9976-0a2cb8522121 req-7a18fc9e-246a-45e6-9049-21a06070a7f7 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received unexpected event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 for instance with vm_state active and task_state None.
Aug 15 02:27:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:27:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:27:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-38ecf515-3653-47d6-9558-cccecd38931f req-606504d1-115a-435a-b32e-9ac10a9d76ea service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-changed-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-38ecf515-3653-47d6-9558-cccecd38931f req-606504d1-115a-435a-b32e-9ac10a9d76ea service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Refreshing instance network info cache due to event network-changed-73961bb4-e1a8-481e-9883-9dbe008a55d9. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:27:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-38ecf515-3653-47d6-9558-cccecd38931f req-606504d1-115a-435a-b32e-9ac10a9d76ea service nova] Acquiring lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:27:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-38ecf515-3653-47d6-9558-cccecd38931f req-606504d1-115a-435a-b32e-9ac10a9d76ea service nova] Acquired lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:27:38 user nova-compute[73121]: DEBUG nova.network.neutron [req-38ecf515-3653-47d6-9558-cccecd38931f req-606504d1-115a-435a-b32e-9ac10a9d76ea service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Refreshing network info cache for port 73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG nova.network.neutron [req-38ecf515-3653-47d6-9558-cccecd38931f req-606504d1-115a-435a-b32e-9ac10a9d76ea service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updated VIF entry in instance network info cache for port 73961bb4-e1a8-481e-9883-9dbe008a55d9. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG nova.network.neutron [req-38ecf515-3653-47d6-9558-cccecd38931f req-606504d1-115a-435a-b32e-9ac10a9d76ea service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-38ecf515-3653-47d6-9558-cccecd38931f req-606504d1-115a-435a-b32e-9ac10a9d76ea service nova] Releasing lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:40 user nova-compute[73121]: INFO nova.compute.manager [None req-e04e6037-703f-4c58-a906-80f5b6a98346 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Unrescuing
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e04e6037-703f-4c58-a906-80f5b6a98346 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e04e6037-703f-4c58-a906-80f5b6a98346 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquired lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e04e6037-703f-4c58-a906-80f5b6a98346 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e04e6037-703f-4c58-a906-80f5b6a98346 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updating instance_info_cache with network_info: [{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e04e6037-703f-4c58-a906-80f5b6a98346 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Releasing lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e04e6037-703f-4c58-a906-80f5b6a98346 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'flavor' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-59ec2032-c00c-4f00-8f26-eec8541f7f67 req-ba404d7f-240b-40b5-a620-36cc51f6ef18 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-unplugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-59ec2032-c00c-4f00-8f26-eec8541f7f67 req-ba404d7f-240b-40b5-a620-36cc51f6ef18 service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-59ec2032-c00c-4f00-8f26-eec8541f7f67 req-ba404d7f-240b-40b5-a620-36cc51f6ef18 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-59ec2032-c00c-4f00-8f26-eec8541f7f67 req-ba404d7f-240b-40b5-a620-36cc51f6ef18 service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-59ec2032-c00c-4f00-8f26-eec8541f7f67 req-ba404d7f-240b-40b5-a620-36cc51f6ef18 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-unplugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:41 user nova-compute[73121]: WARNING nova.compute.manager [req-59ec2032-c00c-4f00-8f26-eec8541f7f67 req-ba404d7f-240b-40b5-a620-36cc51f6ef18 service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-unplugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:27:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:41 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Instance destroyed successfully.
Aug 15 02:27:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:27:41 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e04e6037-703f-4c58-a906-80f5b6a98346 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:45 user nova-compute[73121]: WARNING nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:45 user nova-compute[73121]: WARNING nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:45 user nova-compute[73121]: WARNING nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-unplugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-unplugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:45 user nova-compute[73121]: WARNING nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-unplugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:45 user nova-compute[73121]: WARNING nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:45 user nova-compute[73121]: WARNING nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] No waiting events found dispatching network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:27:45 user nova-compute[73121]: WARNING nova.compute.manager [req-cdac9112-3a78-490f-8218-308cc3c95dfc req-85d53970-1560-44ba-9f7f-393851f2bf6b service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received unexpected event network-vif-plugged-db197fcc-d147-49fa-9c46-9f330534c0e6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066465.0197766, 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:27:45 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] VM Resumed (Lifecycle Event)
Aug 15 02:27:45 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:27:45 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8276MB free_disk=25.26245880126953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:27:45 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066465.0209606, 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:27:45 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] VM Started (Lifecycle Event)
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 716adf87-ce49-44dc-9a75-aa84e27899bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:27:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:27:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:57 user nova-compute[73121]: INFO nova.compute.manager [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Unshelving
Aug 15 02:27:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:57 user nova-compute[73121]: DEBUG nova.objects.instance [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'pci_requests' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:27:57 user nova-compute[73121]: DEBUG nova.objects.instance [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'numa_topology' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:27:57 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:27:57 user nova-compute[73121]: INFO nova.compute.claims [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Claim successful on node user
Aug 15 02:27:57 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:27:57 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:27:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:58 user nova-compute[73121]: INFO nova.network.neutron [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updating port 2225348a-2bc9-438d-810a-9702d8bc4cfe with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 02:27:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:27:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:27:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquired lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:27:58 user nova-compute[73121]: DEBUG nova.network.neutron [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:27:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-43a0e1c9-b95c-45c7-852f-602b8e0fe0fd req-3294ae8f-e89d-4fdb-bd33-4ca349afae0c service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-changed-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:27:58 user nova-compute[73121]: DEBUG nova.compute.manager [req-43a0e1c9-b95c-45c7-852f-602b8e0fe0fd req-3294ae8f-e89d-4fdb-bd33-4ca349afae0c service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Refreshing instance network info cache due to event network-changed-2225348a-2bc9-438d-810a-9702d8bc4cfe. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:27:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43a0e1c9-b95c-45c7-852f-602b8e0fe0fd req-3294ae8f-e89d-4fdb-bd33-4ca349afae0c service nova] Acquiring lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updating instance_info_cache with network_info: [{"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Releasing lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:27:59 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Creating image(s)
Aug 15 02:27:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG nova.objects.instance [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'trusted_certs' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43a0e1c9-b95c-45c7-852f-602b8e0fe0fd req-3294ae8f-e89d-4fdb-bd33-4ca349afae0c service nova] Acquired lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG nova.network.neutron [req-43a0e1c9-b95c-45c7-852f-602b8e0fe0fd req-3294ae8f-e89d-4fdb-bd33-4ca349afae0c service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Refreshing network info cache for port 2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "765991b5997a1b74921ce2e49a3c593bda84e0cb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:27:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "765991b5997a1b74921ce2e49a3c593bda84e0cb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb.part --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:00 user nova-compute[73121]: DEBUG nova.virt.images [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] 9a610846-0932-4c24-aecb-a8ea8b0cd367 was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:28:00 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:28:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb.part /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG nova.network.neutron [req-43a0e1c9-b95c-45c7-852f-602b8e0fe0fd req-3294ae8f-e89d-4fdb-bd33-4ca349afae0c service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updated VIF entry in instance network info cache for port 2225348a-2bc9-438d-810a-9702d8bc4cfe. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG nova.network.neutron [req-43a0e1c9-b95c-45c7-852f-602b8e0fe0fd req-3294ae8f-e89d-4fdb-bd33-4ca349afae0c service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updating instance_info_cache with network_info: [{"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-43a0e1c9-b95c-45c7-852f-602b8e0fe0fd req-3294ae8f-e89d-4fdb-bd33-4ca349afae0c service nova] Releasing lock "refresh_cache-ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb.part /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb.converted" returned: 0 in 0.746s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "765991b5997a1b74921ce2e49a3c593bda84e0cb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.456s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb --force-share --output=json" returned: 0 in 0.170s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "765991b5997a1b74921ce2e49a3c593bda84e0cb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "765991b5997a1b74921ce2e49a3c593bda84e0cb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb,backing_fmt=raw /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb,backing_fmt=raw /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk 1073741824" returned: 0 in 0.057s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "765991b5997a1b74921ce2e49a3c593bda84e0cb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb --force-share --output=json" returned: 0 in 0.173s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'migration_context' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:28:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Rebasing disk image.
Aug 15 02:28:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a -F raw /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a -F raw /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk" returned: 0 in 2.375s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Ensure instance console log exists: /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Start _get_guest_xml network_info=[{"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f5b75001a46aadfd84e6427c25e4f244',container_format='bare',created_at=2023-08-15T02:26:05Z,direct_url=<?>,disk_format='qcow2',id=9a610846-0932-4c24-aecb-a8ea8b0cd367,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1573016178-shelved',owner='203875f0947a423faf1ae9930f401026',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T02:26:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:28:04 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:28:04 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f5b75001a46aadfd84e6427c25e4f244',container_format='bare',created_at=2023-08-15T02:26:05Z,direct_url=<?>,disk_format='qcow2',id=9a610846-0932-4c24-aecb-a8ea8b0cd367,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1573016178-shelved',owner='203875f0947a423faf1ae9930f401026',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-15T02:26:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.objects.instance [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'vcpu_model' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:24:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1573016178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1573016178',id=46,image_ref='9a610846-0932-4c24-aecb-a8ea8b0cd367',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-742960521',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-wwtuzahc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member',shelved_at='2023-08-15T02:26:09.944032',shelved_host='user',shelved_image_id='9a610846-0932-4c24-aecb-a8ea8b0cd367'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.objects.instance [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'pci_devices' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:28:04 user nova-compute[73121]:   <uuid>ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f</uuid>
Aug 15 02:28:04 user nova-compute[73121]:   <name>instance-0000002e</name>
Aug 15 02:28:04 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:28:04 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:28:04 user nova-compute[73121]:   <metadata>
Aug 15 02:28:04 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:28:04 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:28:04 user nova-compute[73121]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1573016178</nova:name>
Aug 15 02:28:04 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:28:04</nova:creationTime>
Aug 15 02:28:04 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:28:04 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:28:04 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:28:04 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:28:04 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:28:04 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:28:04 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:28:04 user nova-compute[73121]:       <nova:owner>
Aug 15 02:28:04 user nova-compute[73121]:         <nova:user uuid="6321528a357e45878a851a10e78226a4">tempest-AttachVolumeShelveTestJSON-201192507-project-member</nova:user>
Aug 15 02:28:04 user nova-compute[73121]:         <nova:project uuid="203875f0947a423faf1ae9930f401026">tempest-AttachVolumeShelveTestJSON-201192507</nova:project>
Aug 15 02:28:04 user nova-compute[73121]:       </nova:owner>
Aug 15 02:28:04 user nova-compute[73121]:       <nova:root type="image" uuid="9a610846-0932-4c24-aecb-a8ea8b0cd367"/>
Aug 15 02:28:04 user nova-compute[73121]:       <nova:ports>
Aug 15 02:28:04 user nova-compute[73121]:         <nova:port uuid="2225348a-2bc9-438d-810a-9702d8bc4cfe">
Aug 15 02:28:04 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:28:04 user nova-compute[73121]:         </nova:port>
Aug 15 02:28:04 user nova-compute[73121]:       </nova:ports>
Aug 15 02:28:04 user nova-compute[73121]:     </nova:instance>
Aug 15 02:28:04 user nova-compute[73121]:   </metadata>
Aug 15 02:28:04 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:28:04 user nova-compute[73121]:     <system>
Aug 15 02:28:04 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:28:04 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:28:04 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:28:04 user nova-compute[73121]:       <entry name="serial">ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f</entry>
Aug 15 02:28:04 user nova-compute[73121]:       <entry name="uuid">ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f</entry>
Aug 15 02:28:04 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:28:04 user nova-compute[73121]:     </system>
Aug 15 02:28:04 user nova-compute[73121]:   </sysinfo>
Aug 15 02:28:04 user nova-compute[73121]:   <os>
Aug 15 02:28:04 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:28:04 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:28:04 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:28:04 user nova-compute[73121]:   </os>
Aug 15 02:28:04 user nova-compute[73121]:   <features>
Aug 15 02:28:04 user nova-compute[73121]:     <acpi/>
Aug 15 02:28:04 user nova-compute[73121]:     <apic/>
Aug 15 02:28:04 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:28:04 user nova-compute[73121]:   </features>
Aug 15 02:28:04 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:28:04 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:28:04 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:28:04 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:28:04 user nova-compute[73121]:   </clock>
Aug 15 02:28:04 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:28:04 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:28:04 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:28:04 user nova-compute[73121]:   </cpu>
Aug 15 02:28:04 user nova-compute[73121]:   <devices>
Aug 15 02:28:04 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:28:04 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:28:04 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk"/>
Aug 15 02:28:04 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:28:04 user nova-compute[73121]:     </disk>
Aug 15 02:28:04 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:28:04 user nova-compute[73121]:       <mac address="fa:16:3e:3e:5f:86"/>
Aug 15 02:28:04 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:28:04 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:28:04 user nova-compute[73121]:       <target dev="tap2225348a-2b"/>
Aug 15 02:28:04 user nova-compute[73121]:     </interface>
Aug 15 02:28:04 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:28:04 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/console.log" append="off"/>
Aug 15 02:28:04 user nova-compute[73121]:     </serial>
Aug 15 02:28:04 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:28:04 user nova-compute[73121]:     <video>
Aug 15 02:28:04 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:28:04 user nova-compute[73121]:     </video>
Aug 15 02:28:04 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:28:04 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:28:04 user nova-compute[73121]:     </rng>
Aug 15 02:28:04 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:28:04 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:28:04 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:28:04 user nova-compute[73121]:     </memballoon>
Aug 15 02:28:04 user nova-compute[73121]:   </devices>
Aug 15 02:28:04 user nova-compute[73121]: </domain>
Aug 15 02:28:04 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:24:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1573016178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1573016178',id=46,image_ref='9a610846-0932-4c24-aecb-a8ea8b0cd367',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-742960521',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:24:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-wwtuzahc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member',shelved_at='2023-08-15T02:26:09.944032',shelved_host='user',shelved_image_id='9a610846-0932-4c24-aecb-a8ea8b0cd367'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG os_vif [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2225348a-2b, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2225348a-2b, col_values=(('external_ids', {'iface-id': '2225348a-2bc9-438d-810a-9702d8bc4cfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:5f:86', 'vm-uuid': 'ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:28:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:04 user nova-compute[73121]: INFO os_vif [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b')
Aug 15 02:28:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:28:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] No VIF found with MAC fa:16:3e:3e:5f:86, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-c2a97db2-cf1c-471f-95d7-ef6b363515f5 req-9a4c7567-2c38-4c64-89e2-be3f9d587a38 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c2a97db2-cf1c-471f-95d7-ef6b363515f5 req-9a4c7567-2c38-4c64-89e2-be3f9d587a38 service nova] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c2a97db2-cf1c-471f-95d7-ef6b363515f5 req-9a4c7567-2c38-4c64-89e2-be3f9d587a38 service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c2a97db2-cf1c-471f-95d7-ef6b363515f5 req-9a4c7567-2c38-4c64-89e2-be3f9d587a38 service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-c2a97db2-cf1c-471f-95d7-ef6b363515f5 req-9a4c7567-2c38-4c64-89e2-be3f9d587a38 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] No waiting events found dispatching network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:28:06 user nova-compute[73121]: WARNING nova.compute.manager [req-c2a97db2-cf1c-471f-95d7-ef6b363515f5 req-9a4c7567-2c38-4c64-89e2-be3f9d587a38 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received unexpected event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 02:28:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-a3abcebe-3f3f-4526-a37d-eb9b85a5e8cc req-134d0a5e-4923-445d-87bb-18203c3e9ef0 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a3abcebe-3f3f-4526-a37d-eb9b85a5e8cc req-134d0a5e-4923-445d-87bb-18203c3e9ef0 service nova] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a3abcebe-3f3f-4526-a37d-eb9b85a5e8cc req-134d0a5e-4923-445d-87bb-18203c3e9ef0 service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a3abcebe-3f3f-4526-a37d-eb9b85a5e8cc req-134d0a5e-4923-445d-87bb-18203c3e9ef0 service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.compute.manager [req-a3abcebe-3f3f-4526-a37d-eb9b85a5e8cc req-134d0a5e-4923-445d-87bb-18203c3e9ef0 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] No waiting events found dispatching network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:28:08 user nova-compute[73121]: WARNING nova.compute.manager [req-a3abcebe-3f3f-4526-a37d-eb9b85a5e8cc req-134d0a5e-4923-445d-87bb-18203c3e9ef0 service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received unexpected event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066488.5694947, ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:28:08 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] VM Resumed (Lifecycle Event)
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:28:08 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance spawned successfully.
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:28:08 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066488.5711312, ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:28:08 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] VM Started (Lifecycle Event)
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:28:08 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:28:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:28:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-72b88d21-0acb-4290-a1d0-14b46f838cfd tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.342s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:37 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:28:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updating instance_info_cache with network_info: [{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:41 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:28:42 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:28:42 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8179MB free_disk=25.2353515625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 716adf87-ce49-44dc-9a75-aa84e27899bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:28:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-c906f831-54f9-4549-bebd-6fd0759eb376 req-8b02e5fc-c8d2-41d3-b488-7cc80f319c57 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-c906f831-54f9-4549-bebd-6fd0759eb376 req-8b02e5fc-c8d2-41d3-b488-7cc80f319c57 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing instance network info cache due to event network-changed-d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c906f831-54f9-4549-bebd-6fd0759eb376 req-8b02e5fc-c8d2-41d3-b488-7cc80f319c57 service nova] Acquiring lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c906f831-54f9-4549-bebd-6fd0759eb376 req-8b02e5fc-c8d2-41d3-b488-7cc80f319c57 service nova] Acquired lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-c906f831-54f9-4549-bebd-6fd0759eb376 req-8b02e5fc-c8d2-41d3-b488-7cc80f319c57 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Refreshing network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:48 user nova-compute[73121]: INFO nova.compute.manager [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Terminating instance
Aug 15 02:28:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-c906f831-54f9-4549-bebd-6fd0759eb376 req-8b02e5fc-c8d2-41d3-b488-7cc80f319c57 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updated VIF entry in instance network info cache for port d2e719c6-982b-4d93-a266-8a0dfe7775f6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG nova.network.neutron [req-c906f831-54f9-4549-bebd-6fd0759eb376 req-8b02e5fc-c8d2-41d3-b488-7cc80f319c57 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [{"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c906f831-54f9-4549-bebd-6fd0759eb376 req-8b02e5fc-c8d2-41d3-b488-7cc80f319c57 service nova] Releasing lock "refresh_cache-716adf87-ce49-44dc-9a75-aa84e27899bb" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-c68f9e52-349a-4393-a39f-4182ea0a14b9 req-c117de23-7a71-49ed-b437-9c19a1c56bb6 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-unplugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c68f9e52-349a-4393-a39f-4182ea0a14b9 req-c117de23-7a71-49ed-b437-9c19a1c56bb6 service nova] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c68f9e52-349a-4393-a39f-4182ea0a14b9 req-c117de23-7a71-49ed-b437-9c19a1c56bb6 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c68f9e52-349a-4393-a39f-4182ea0a14b9 req-c117de23-7a71-49ed-b437-9c19a1c56bb6 service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-c68f9e52-349a-4393-a39f-4182ea0a14b9 req-c117de23-7a71-49ed-b437-9c19a1c56bb6 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] No waiting events found dispatching network-vif-unplugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:28:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-c68f9e52-349a-4393-a39f-4182ea0a14b9 req-c117de23-7a71-49ed-b437-9c19a1c56bb6 service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-unplugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:28:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Instance destroyed successfully.
Aug 15 02:28:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lazy-loading 'resources' on Instance uuid 716adf87-ce49-44dc-9a75-aa84e27899bb {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2081680432',display_name='tempest-TestShelveInstance-server-2081680432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2081680432',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsb/32naL56zFYGKJYVChKcu6sG4pgdZgsBx746CMktm84wViywkiGQGrVGqBMP/vV4JKbvg/e66FF8Cnqz4+6fO0SOR5pSSkPBpgFZ9lkTneyXfb8HU/MoS0rHBa0xtQ==',key_name='tempest-TestShelveInstance-280997968',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='810dbe4d00334869a75c7307a19e46e5',ramdisk_id='',reservation_id='r-r9mfxb04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1123354322',owner_user_name='tempest-TestShelveInstance-1123354322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:27:13Z,user_data=None,user_id='70f546300273431c8f3d51b8a828be22',uuid=716adf87-ce49-44dc-9a75-aa84e27899bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converting VIF {"id": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "address": "fa:16:3e:f4:9d:1b", "network": {"id": "41c487b2-a669-4385-9ded-af203d1260f8", "bridge": "br-int", "label": "tempest-TestShelveInstance-1267995120-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "810dbe4d00334869a75c7307a19e46e5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2e719c6-98", "ovs_interfaceid": "d2e719c6-982b-4d93-a266-8a0dfe7775f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_vif [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2e719c6-98, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:28:49 user nova-compute[73121]: INFO os_vif [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=d2e719c6-982b-4d93-a266-8a0dfe7775f6,network=Network(41c487b2-a669-4385-9ded-af203d1260f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2e719c6-98')
Aug 15 02:28:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUCHucVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:28:49 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[819b35cb-fe01-4283-b624-4dc5f3727ea3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7954ee79-2270-4344-908b-4de1784b2780]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:28:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d (non-flash)
Aug 15 02:28:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e20789d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[752b353f-6792-43e1-93db-ccb1fc2ddccb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ab891d-e783-48c9-abc6-5b4415a95f34]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2869825f-1d00-4f62-bf83-05e59ad40632]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc207f-564c-4356-9118-fce9a8f278a3]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23534323264663138', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1b8cfb45', '/dev/disk/by-id/scsi-1SCST_BIO1b8cfb45-5422df183862e0a5') {{(pid=84043) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dbbabc-7ed5-43e4-b362-4eb04fcceeae]: (4, None) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca31058f-5030-4a8f-8076-243700c02b71]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20cb7f0-7fef-4b6e-b018-b99ebdddb37c]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260]
Aug 15 02:28:49 user nova-compute[73121]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d, portal: 172.16.0.220,3260] successful.
Aug 15 02:28:49 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab6e7dff-15a6-49c9-9849-ea840151270d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf67001-abee-4d68-b0aa-81104feee6c2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] <== disconnect_volume: return (261ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:28:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Deleting instance files /opt/stack/data/nova/instances/716adf87-ce49-44dc-9a75-aa84e27899bb_del
Aug 15 02:28:49 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Deletion of /opt/stack/data/nova/instances/716adf87-ce49-44dc-9a75-aa84e27899bb_del complete
Aug 15 02:28:49 user nova-compute[73121]: INFO nova.compute.manager [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 15 02:28:49 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:28:49 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:28:50 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:28:50 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Took 0.87 seconds to deallocate network for instance.
Aug 15 02:28:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-89b0e645-71f0-4fdf-9063-f340d2354ad5 req-0efc8fff-67af-4c8e-8535-99b1f04d1eae service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-deleted-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-71923734-9835-446c-8dd3-5c7bde931644 req-fe595d49-3346-4657-8edc-8805dfb5292c service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-71923734-9835-446c-8dd3-5c7bde931644 req-fe595d49-3346-4657-8edc-8805dfb5292c service nova] Acquiring lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-71923734-9835-446c-8dd3-5c7bde931644 req-fe595d49-3346-4657-8edc-8805dfb5292c service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-71923734-9835-446c-8dd3-5c7bde931644 req-fe595d49-3346-4657-8edc-8805dfb5292c service nova] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-71923734-9835-446c-8dd3-5c7bde931644 req-fe595d49-3346-4657-8edc-8805dfb5292c service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] No waiting events found dispatching network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:28:51 user nova-compute[73121]: WARNING nova.compute.manager [req-71923734-9835-446c-8dd3-5c7bde931644 req-fe595d49-3346-4657-8edc-8805dfb5292c service nova] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Received unexpected event network-vif-plugged-d2e719c6-982b-4d93-a266-8a0dfe7775f6 for instance with vm_state active and task_state deleting.
Aug 15 02:28:51 user nova-compute[73121]: INFO nova.compute.manager [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Took 0.72 seconds to detach 1 volumes for instance.
Aug 15 02:28:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Deleting volume: ab6e7dff-15a6-49c9-9849-ea840151270d {{(pid=73121) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:28:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:51 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Deleted allocations for instance 716adf87-ce49-44dc-9a75-aa84e27899bb
Aug 15 02:28:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6ee38b05-7572-4e0a-b9f1-7bc4cecb2f3c tempest-TestShelveInstance-1123354322 tempest-TestShelveInstance-1123354322-project-member] Lock "716adf87-ce49-44dc-9a75-aa84e27899bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.191s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:28:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:28:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:28:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:28:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:28:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:28:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:28:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:04 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066529.3752227, 716adf87-ce49-44dc-9a75-aa84e27899bb => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:29:04 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] VM Stopped (Lifecycle Event)
Aug 15 02:29:04 user nova-compute[73121]: DEBUG nova.compute.manager [None req-cdbb462b-c397-4d5d-8439-c4ebc3572014 None None] [instance: 716adf87-ce49-44dc-9a75-aa84e27899bb] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:29:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:29:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:29:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:29:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:29:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:29:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:29:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:29:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:29:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG nova.objects.instance [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'flavor' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:34 user nova-compute[73121]: INFO nova.compute.manager [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Attaching volume 4b86422f-248b-4cf1-80dd-3e3c448c0c1d to /dev/vdb
Aug 15 02:29:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1a0cf2-84f6-4ba2-acea-455554c064b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f2b617-5fc4-4b88-a9c8-172a7c7221c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[56966a76-354c-43b5-813a-30e2cb1ddffc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[38273925-c52c-4abc-a932-e41b25472f6e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:29:34 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:29:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[55460421-7dc4-48f3-af2d-d8afd950e903]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG os_brick.utils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:29:34 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating existing volume attachment record: 995fda7b-1bba-43b0-8ad9-2b412f881da0 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:29:35 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:29:35 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:29:36 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:29:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:29:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:29:39 user nova-compute[73121]: INFO nova.compute.claims [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Claim successful on node user
Aug 15 02:29:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:29:39 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.policy [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5012859ad374ac0b441cc5a5739cf4e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c202114f5c584284a72d52cececc4b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:29:39 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Creating image(s)
Aug 15 02:29:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:39 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk 1073741824" returned: 0 in 0.051s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Cannot resize image /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'migration_context' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Ensure instance console log exists: /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Successfully created port: 763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updating instance_info_cache with network_info: [{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Successfully updated port: 763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquired lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:29:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-ef8af1b0-a086-4d96-a67e-1f9e7b1f052d req-89e20b36-34ad-4044-9339-4149558c9ff9 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-changed-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-ef8af1b0-a086-4d96-a67e-1f9e7b1f052d req-89e20b36-34ad-4044-9339-4149558c9ff9 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Refreshing instance network info cache due to event network-changed-763418ec-aa43-4cb0-8a6c-8d90a11de5db. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef8af1b0-a086-4d96-a67e-1f9e7b1f052d req-89e20b36-34ad-4044-9339-4149558c9ff9 service nova] Acquiring lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating instance_info_cache with network_info: [{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Releasing lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Instance network_info: |[{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef8af1b0-a086-4d96-a67e-1f9e7b1f052d req-89e20b36-34ad-4044-9339-4149558c9ff9 service nova] Acquired lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.network.neutron [req-ef8af1b0-a086-4d96-a67e-1f9e7b1f052d req-89e20b36-34ad-4044-9339-4149558c9ff9 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Refreshing network info cache for port 763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Start _get_guest_xml network_info=[{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:29:42 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:29:42 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1334642393',display_name='tempest-ServerRescueNegativeTestJSON-server-1334642393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1334642393',id=48,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrBKQDhf63xKfzygFzHqTcClP3fPLPjZleMtvoqYdSNuDGoHYvBiWiUH3BSiIlLTZfeH0OF0Ry7ReviEO+9ZHPmxLI4h4oAbL/G1fFiKntcUXiEZef88ZJW7BUnjHmawQ==',key_name='tempest-keypair-1977733763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-aezvhlip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=45755efe-f0af-43db-adf6-1b11505e942e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=763418ec-aa43-4cb0-8a6c-8d90a11de5db,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763418ec-aa') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'pci_devices' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:29:42 user nova-compute[73121]:   <uuid>45755efe-f0af-43db-adf6-1b11505e942e</uuid>
Aug 15 02:29:42 user nova-compute[73121]:   <name>instance-00000030</name>
Aug 15 02:29:42 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:29:42 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:29:42 user nova-compute[73121]:   <metadata>
Aug 15 02:29:42 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:29:42 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:29:42 user nova-compute[73121]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1334642393</nova:name>
Aug 15 02:29:42 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:29:42</nova:creationTime>
Aug 15 02:29:42 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:29:42 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:29:42 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:29:42 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:29:42 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:29:42 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:29:42 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:29:42 user nova-compute[73121]:       <nova:owner>
Aug 15 02:29:42 user nova-compute[73121]:         <nova:user uuid="c5012859ad374ac0b441cc5a5739cf4e">tempest-ServerRescueNegativeTestJSON-704093322-project-member</nova:user>
Aug 15 02:29:42 user nova-compute[73121]:         <nova:project uuid="c202114f5c584284a72d52cececc4b34">tempest-ServerRescueNegativeTestJSON-704093322</nova:project>
Aug 15 02:29:42 user nova-compute[73121]:       </nova:owner>
Aug 15 02:29:42 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:29:42 user nova-compute[73121]:       <nova:ports>
Aug 15 02:29:42 user nova-compute[73121]:         <nova:port uuid="763418ec-aa43-4cb0-8a6c-8d90a11de5db">
Aug 15 02:29:42 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 02:29:42 user nova-compute[73121]:         </nova:port>
Aug 15 02:29:42 user nova-compute[73121]:       </nova:ports>
Aug 15 02:29:42 user nova-compute[73121]:     </nova:instance>
Aug 15 02:29:42 user nova-compute[73121]:   </metadata>
Aug 15 02:29:42 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:29:42 user nova-compute[73121]:     <system>
Aug 15 02:29:42 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:29:42 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:29:42 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:29:42 user nova-compute[73121]:       <entry name="serial">45755efe-f0af-43db-adf6-1b11505e942e</entry>
Aug 15 02:29:42 user nova-compute[73121]:       <entry name="uuid">45755efe-f0af-43db-adf6-1b11505e942e</entry>
Aug 15 02:29:42 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:29:42 user nova-compute[73121]:     </system>
Aug 15 02:29:42 user nova-compute[73121]:   </sysinfo>
Aug 15 02:29:42 user nova-compute[73121]:   <os>
Aug 15 02:29:42 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:29:42 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:29:42 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:29:42 user nova-compute[73121]:   </os>
Aug 15 02:29:42 user nova-compute[73121]:   <features>
Aug 15 02:29:42 user nova-compute[73121]:     <acpi/>
Aug 15 02:29:42 user nova-compute[73121]:     <apic/>
Aug 15 02:29:42 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:29:42 user nova-compute[73121]:   </features>
Aug 15 02:29:42 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:29:42 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:29:42 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:29:42 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:29:42 user nova-compute[73121]:   </clock>
Aug 15 02:29:42 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:29:42 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:29:42 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:29:42 user nova-compute[73121]:   </cpu>
Aug 15 02:29:42 user nova-compute[73121]:   <devices>
Aug 15 02:29:42 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:29:42 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:29:42 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk"/>
Aug 15 02:29:42 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:29:42 user nova-compute[73121]:     </disk>
Aug 15 02:29:42 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:29:42 user nova-compute[73121]:       <mac address="fa:16:3e:d8:fb:7f"/>
Aug 15 02:29:42 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:29:42 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:29:42 user nova-compute[73121]:       <target dev="tap763418ec-aa"/>
Aug 15 02:29:42 user nova-compute[73121]:     </interface>
Aug 15 02:29:42 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:29:42 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/console.log" append="off"/>
Aug 15 02:29:42 user nova-compute[73121]:     </serial>
Aug 15 02:29:42 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:29:42 user nova-compute[73121]:     <video>
Aug 15 02:29:42 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:29:42 user nova-compute[73121]:     </video>
Aug 15 02:29:42 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:29:42 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:29:42 user nova-compute[73121]:     </rng>
Aug 15 02:29:42 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:29:42 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:29:42 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:29:42 user nova-compute[73121]:     </memballoon>
Aug 15 02:29:42 user nova-compute[73121]:   </devices>
Aug 15 02:29:42 user nova-compute[73121]: </domain>
Aug 15 02:29:42 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1334642393',display_name='tempest-ServerRescueNegativeTestJSON-server-1334642393',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1334642393',id=48,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrBKQDhf63xKfzygFzHqTcClP3fPLPjZleMtvoqYdSNuDGoHYvBiWiUH3BSiIlLTZfeH0OF0Ry7ReviEO+9ZHPmxLI4h4oAbL/G1fFiKntcUXiEZef88ZJW7BUnjHmawQ==',key_name='tempest-keypair-1977733763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-aezvhlip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=45755efe-f0af-43db-adf6-1b11505e942e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=763418ec-aa43-4cb0-8a6c-8d90a11de5db,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763418ec-aa') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG os_vif [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=763418ec-aa43-4cb0-8a6c-8d90a11de5db,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763418ec-aa') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap763418ec-aa, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap763418ec-aa, col_values=(('external_ids', {'iface-id': '763418ec-aa43-4cb0-8a6c-8d90a11de5db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:fb:7f', 'vm-uuid': '45755efe-f0af-43db-adf6-1b11505e942e'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:42 user nova-compute[73121]: INFO os_vif [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=763418ec-aa43-4cb0-8a6c-8d90a11de5db,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763418ec-aa')
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No VIF found with MAC fa:16:3e:d8:fb:7f, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.network.neutron [req-ef8af1b0-a086-4d96-a67e-1f9e7b1f052d req-89e20b36-34ad-4044-9339-4149558c9ff9 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updated VIF entry in instance network info cache for port 763418ec-aa43-4cb0-8a6c-8d90a11de5db. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG nova.network.neutron [req-ef8af1b0-a086-4d96-a67e-1f9e7b1f052d req-89e20b36-34ad-4044-9339-4149558c9ff9 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating instance_info_cache with network_info: [{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:29:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ef8af1b0-a086-4d96-a67e-1f9e7b1f052d req-89e20b36-34ad-4044-9339-4149558c9ff9 service nova] Releasing lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:29:43 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:29:43 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:29:43 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82d2838-da0f-416f-ac3f-a0583bb6b64f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:29:43 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c77216-8215-4185-943b-68c8dfcd54ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d] added
Aug 15 02:29:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb70cbd-ab44-4f95-9d9a-980334184977]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9a313a-0c2a-43e2-8e7b-bab561b95f26]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjAuvDRS {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjAuvDRS" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2d5d31-c95e-40a5-a725-453842b99443]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cjAuvDRS'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d894d816-c231-4952-9839-d8c97230c562]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[272b0be4-814f-422e-8036-cd84a0de9c28]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:29:43 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:29:43 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:29:43 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:29:43 user nova-compute[73121]: 
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[62083ac8-b359-4f3c-8a2c-354605f12a9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]
Aug 15 02:29:43 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.
Aug 15 02:29:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc848a08-5a41-4a4e-a004-51cb797fe2e7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e0e98b-d4ba-41a8-b358-0b4afcead9c4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:29:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:29:43 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9a5f87-8511-49af-b520-f373557cb07f]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-4b5ada62-b5f7-4000-93dd-1d465174979a req-681f7c70-9ecb-49a8-b2b3-f18e174a646a service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:29:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4b5ada62-b5f7-4000-93dd-1d465174979a req-681f7c70-9ecb-49a8-b2b3-f18e174a646a service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4b5ada62-b5f7-4000-93dd-1d465174979a req-681f7c70-9ecb-49a8-b2b3-f18e174a646a service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-4b5ada62-b5f7-4000-93dd-1d465174979a req-681f7c70-9ecb-49a8-b2b3-f18e174a646a service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:44 user nova-compute[73121]: DEBUG nova.compute.manager [req-4b5ada62-b5f7-4000-93dd-1d465174979a req-681f7c70-9ecb-49a8-b2b3-f18e174a646a service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:29:44 user nova-compute[73121]: WARNING nova.compute.manager [req-4b5ada62-b5f7-4000-93dd-1d465174979a req-681f7c70-9ecb-49a8-b2b3-f18e174a646a service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state building and task_state spawning.
Aug 15 02:29:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066586.117738, 45755efe-f0af-43db-adf6-1b11505e942e => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:29:46 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] VM Resumed (Lifecycle Event)
Aug 15 02:29:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.058s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] <== connect_volume: return (3060ms) {'type': 'block', 'scsi_wwn': '23965343532633238', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965343532633238', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:29:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:29:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8348MB free_disk=25.225666046142578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-92745c93-bb19-4a9e-bb17-d60472ec6958 req-e60be85d-49df-4afa-9b6e-05e690e18d52 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-92745c93-bb19-4a9e-bb17-d60472ec6958 req-e60be85d-49df-4afa-9b6e-05e690e18d52 service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-92745c93-bb19-4a9e-bb17-d60472ec6958 req-e60be85d-49df-4afa-9b6e-05e690e18d52 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-92745c93-bb19-4a9e-bb17-d60472ec6958 req-e60be85d-49df-4afa-9b6e-05e690e18d52 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.manager [req-92745c93-bb19-4a9e-bb17-d60472ec6958 req-e60be85d-49df-4afa-9b6e-05e690e18d52 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:29:46 user nova-compute[73121]: WARNING nova.compute.manager [req-92745c93-bb19-4a9e-bb17-d60472ec6958 req-e60be85d-49df-4afa-9b6e-05e690e18d52 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state building and task_state spawning.
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:29:46 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Instance spawned successfully.
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.objects.instance [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'flavor' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:29:46 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:29:46 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:29:46 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:29:46 user nova-compute[73121]:   <serial>4b86422f-248b-4cf1-80dd-3e3c448c0c1d</serial>
Aug 15 02:29:46 user nova-compute[73121]: </disk>
Aug 15 02:29:46 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:29:46 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066586.118378, 45755efe-f0af-43db-adf6-1b11505e942e => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:29:46 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] VM Started (Lifecycle Event)
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:29:46 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 45755efe-f0af-43db-adf6-1b11505e942e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:29:46 user nova-compute[73121]: INFO nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Took 6.67 seconds to spawn the instance on the hypervisor.
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:29:46 user nova-compute[73121]: INFO nova.compute.manager [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Took 7.45 seconds to build instance.
Aug 15 02:29:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6d900a73-a5ce-4450-8664-bd3d111898f9 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.574s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] No VIF found with MAC fa:16:3e:92:6c:c0, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:29:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-86cd3f70-24d3-4568-b426-f13ce8b9fc41 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.707s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:47 user nova-compute[73121]: INFO nova.compute.manager [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Terminating instance
Aug 15 02:29:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:29:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b4ac12f-c033-464c-8294-c9cf505290c4 req-fe873c73-1e0b-4b16-bdeb-caf3648e670a service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-unplugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b4ac12f-c033-464c-8294-c9cf505290c4 req-fe873c73-1e0b-4b16-bdeb-caf3648e670a service nova] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b4ac12f-c033-464c-8294-c9cf505290c4 req-fe873c73-1e0b-4b16-bdeb-caf3648e670a service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0b4ac12f-c033-464c-8294-c9cf505290c4 req-fe873c73-1e0b-4b16-bdeb-caf3648e670a service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b4ac12f-c033-464c-8294-c9cf505290c4 req-fe873c73-1e0b-4b16-bdeb-caf3648e670a service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] No waiting events found dispatching network-vif-unplugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.compute.manager [req-0b4ac12f-c033-464c-8294-c9cf505290c4 req-fe873c73-1e0b-4b16-bdeb-caf3648e670a service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-unplugged-2225348a-2bc9-438d-810a-9702d8bc4cfe for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:29:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Instance destroyed successfully.
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lazy-loading 'resources' on Instance uuid ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T02:24:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1573016178',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1573016178',id=46,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0CybmE9myuAGhYvCYfuBxDAuo6u0/SHZffq95vLxhi23l3anIGFkGaWmCRHH5OlrGTkqQR2IC8QlJhrL9PLUl24i6sCHujzNc9h3kZfqSh+4Yem/ymmndCH/2pT8Nk5Q==',key_name='tempest-keypair-742960521',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:28:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='203875f0947a423faf1ae9930f401026',ramdisk_id='',reservation_id='r-wwtuzahc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-201192507',owner_user_name='tempest-AttachVolumeShelveTestJSON-201192507-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:28:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6321528a357e45878a851a10e78226a4',uuid=ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converting VIF {"id": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "address": "fa:16:3e:3e:5f:86", "network": {"id": "5828d121-543f-4c9c-b9dc-434fd3c59895", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1397468945-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "203875f0947a423faf1ae9930f401026", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2225348a-2b", "ovs_interfaceid": "2225348a-2bc9-438d-810a-9702d8bc4cfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG os_vif [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2225348a-2b, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:29:48 user nova-compute[73121]: INFO os_vif [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:5f:86,bridge_name='br-int',has_traffic_filtering=True,id=2225348a-2bc9-438d-810a-9702d8bc4cfe,network=Network(5828d121-543f-4c9c-b9dc-434fd3c59895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2225348a-2b')
Aug 15 02:29:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Deleting instance files /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f_del
Aug 15 02:29:48 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Deletion of /opt/stack/data/nova/instances/ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f_del complete
Aug 15 02:29:48 user nova-compute[73121]: INFO nova.compute.manager [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 02:29:48 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Stashing vm_state: active {{(pid=73121) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'pci_requests' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:29:49 user nova-compute[73121]: INFO nova.compute.claims [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Claim successful on node user
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'resources' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.objects.instance [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'pci_devices' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:29:49 user nova-compute[73121]: INFO nova.compute.resource_tracker [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating resource usage from migration de63cdb2-9900-440e-85f1-90a831cd42db
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.381s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:49 user nova-compute[73121]: INFO nova.compute.manager [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Migrating
Aug 15 02:29:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquired lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:29:49 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Took 0.99 seconds to deallocate network for instance.
Aug 15 02:29:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:29:49 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Releasing lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:29:50 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Deleted allocations for instance ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f
Aug 15 02:29:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c19a322-73a3-43e0-a944-33539642225a tempest-AttachVolumeShelveTestJSON-201192507 tempest-AttachVolumeShelveTestJSON-201192507-project-member] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.310s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Starting migrate_disk_and_power_off {{(pid=73121) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-490bf964-79c7-47a8-9175-8e1a4319e91b req-085bf030-04a8-4433-ab91-936892bbd7fb service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-490bf964-79c7-47a8-9175-8e1a4319e91b req-085bf030-04a8-4433-ab91-936892bbd7fb service nova] Acquiring lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-490bf964-79c7-47a8-9175-8e1a4319e91b req-085bf030-04a8-4433-ab91-936892bbd7fb service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-490bf964-79c7-47a8-9175-8e1a4319e91b req-085bf030-04a8-4433-ab91-936892bbd7fb service nova] Lock "ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-490bf964-79c7-47a8-9175-8e1a4319e91b req-085bf030-04a8-4433-ab91-936892bbd7fb service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] No waiting events found dispatching network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:29:50 user nova-compute[73121]: WARNING nova.compute.manager [req-490bf964-79c7-47a8-9175-8e1a4319e91b req-085bf030-04a8-4433-ab91-936892bbd7fb service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received unexpected event network-vif-plugged-2225348a-2bc9-438d-810a-9702d8bc4cfe for instance with vm_state deleted and task_state None.
Aug 15 02:29:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-490bf964-79c7-47a8-9175-8e1a4319e91b req-085bf030-04a8-4433-ab91-936892bbd7fb service nova] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Received event network-vif-deleted-2225348a-2bc9-438d-810a-9702d8bc4cfe {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-277d5148-7bcb-4dfa-8564-48238314b3d0 req-2d3394eb-3514-418e-b6b0-cb66848f4fbe service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-unplugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-277d5148-7bcb-4dfa-8564-48238314b3d0 req-2d3394eb-3514-418e-b6b0-cb66848f4fbe service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-277d5148-7bcb-4dfa-8564-48238314b3d0 req-2d3394eb-3514-418e-b6b0-cb66848f4fbe service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-277d5148-7bcb-4dfa-8564-48238314b3d0 req-2d3394eb-3514-418e-b6b0-cb66848f4fbe service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-277d5148-7bcb-4dfa-8564-48238314b3d0 req-2d3394eb-3514-418e-b6b0-cb66848f4fbe service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-unplugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:29:50 user nova-compute[73121]: WARNING nova.compute.manager [req-277d5148-7bcb-4dfa-8564-48238314b3d0 req-2d3394eb-3514-418e-b6b0-cb66848f4fbe service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-unplugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state active and task_state resize_migrating.
Aug 15 02:29:51 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance destroyed successfully.
Aug 15 02:29:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949422126',display_name='tempest-ServerActionsTestOtherB-server-949422126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949422126',id=47,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHtT/z4+EwvsQypxm7gdMPNSlReNYTbUu3hKKgnLffbACwld+psBjNbQUUl3fZeJ92B3U1PN95LB9d30L8XORPoR9Kn5sBYGKVZpr0ZJgl63wFEoFNzSdCWjJwXJdBIRA==',key_name='tempest-keypair-1894281607',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e42e645406e44a9286cfb543f9d30064',ramdisk_id='',reservation_id='r-pxwx7fmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1222409128',owner_user_name='tempest-ServerActionsTestOtherB-1222409128-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88947c21cb5b4c41969a408f949666c4',uuid=a8f1af9c-f6d1-4840-bf52-ba2526c558b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-675599451-network", "vif_mac": "fa:16:3e:92:6c:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converting VIF {"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-675599451-network", "vif_mac": "fa:16:3e:92:6c:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_vif [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73961bb4-e1, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:29:51 user nova-compute[73121]: INFO os_vif [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1')
Aug 15 02:29:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:29:51 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f44254d-3c1a-42a8-abaa-42e1fc91059e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33424b6-dc1a-4036-a253-f382ff28ea76]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:29:51 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:29:51 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e34cdd120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fa2c18-bc58-4210-b609-2c1d66d75a1b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eac5bca-ed2f-40dd-ae8f-04cad16b395d]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ed7d59-182d-4f15-95cf-3d95f280869c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[381abc11-f017-472e-b5e2-cf57c334a131]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd5179-c4eb-453e-a5f0-173623107d5a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[418b9bc6-ff24-445c-b669-78c3f3a1b849]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]
Aug 15 02:29:51 user nova-compute[73121]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.
Aug 15 02:29:51 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[580e6c27-ff25-469a-9b32-284ad8ec6d1a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] <== disconnect_volume: return (277ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0_resize/disk /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "cp -r /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0_resize/disk /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk" returned: 0 in 0.202s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0_resize/disk.info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk.info {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "cp -r /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0_resize/disk.info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk.info" returned: 0 in 0.042s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-63cb91f9-d693-49db-bf00-13ae57c234f8 req-e61e96d0-a27f-48ad-b12c-964045e14b90 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:29:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63cb91f9-d693-49db-bf00-13ae57c234f8 req-e61e96d0-a27f-48ad-b12c-964045e14b90 service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63cb91f9-d693-49db-bf00-13ae57c234f8 req-e61e96d0-a27f-48ad-b12c-964045e14b90 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63cb91f9-d693-49db-bf00-13ae57c234f8 req-e61e96d0-a27f-48ad-b12c-964045e14b90 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-63cb91f9-d693-49db-bf00-13ae57c234f8 req-e61e96d0-a27f-48ad-b12c-964045e14b90 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:29:52 user nova-compute[73121]: WARNING nova.compute.manager [req-63cb91f9-d693-49db-bf00-13ae57c234f8 req-e61e96d0-a27f-48ad-b12c-964045e14b90 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state active and task_state resize_migrating.
Aug 15 02:29:52 user nova-compute[73121]: DEBUG nova.network.neutron [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Port 73961bb4-e1a8-481e-9883-9dbe008a55d9 binding to destination host user is already ACTIVE {{(pid=73121) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquired lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Releasing lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG os_brick.utils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0653d6e-b0ab-4423-b980-a92988c5be93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3507209-df96-40f7-b681-e96a75e6cb8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4140b473-9249-476e-9540-7392b6d562e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[132df973-6cb2-4c22-9134-6159f1b74309]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:29:53 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:29:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47c196d-2686-42ad-be55-f78ffc2ae4db]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:29:53 user nova-compute[73121]: DEBUG os_brick.utils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:29:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Starting finish_migration {{(pid=73121) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance directory exists: not creating {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 02:30:02 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Creating image(s)
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'trusted_certs' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk. size=21474836480 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk 21474836480 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk 21474836480" returned: 0 in 0.048s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Did not create local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Ensure instance console log exists: /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Start _get_guest_xml network_info=[{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-675599451-network", "vif_mac": "fa:16:3e:92:6c:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': '335542c4-12a4-48ab-a86c-9ba4f3df613a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a8f1af9c-f6d1-4840-bf52-ba2526c558b0', 'attached_at': '2023-08-15T02:30:02.000000', 'detached_at': '', 'volume_id': '4b86422f-248b-4cf1-80dd-3e3c448c0c1d', 'serial': '4b86422f-248b-4cf1-80dd-3e3c448c0c1d'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:30:02 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:30:02 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:30:02 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:30:02 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:30:02 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ce8444-51da-4226-9844-0bbdd9b52840]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:30:02 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[337a3e81-614d-4bf3-9b60-184a1734dfaf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d] added
Aug 15 02:30:02 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fe0b90-6471-42a7-aff1-5c44652c8ff2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[66505f0f-3dbf-4967-bfca-a101329e82a3]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjAuvDRS {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjAuvDRS" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70450f6-83aa-4933-b33b-0e66bcc1ec39]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cjAuvDRS'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf4ebd1-b61b-4dea-80e9-9b15a4efdfc4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6b68ac-a871-4399-b1f3-d7df372894a2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:30:02 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:30:02 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:30:02 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:30:02 user nova-compute[73121]: 
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93a9e1d-aee6-4196-9206-e9bb5421e4ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]
Aug 15 02:30:02 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.
Aug 15 02:30:02 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:30:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[664f3c3f-631b-4903-b72d-d2bfdfdc137d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1615a3-7fbf-4876-85cc-6251e0e12142]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:30:03 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:30:03 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cec73d8-b502-4e5c-a7c3-bff7b5aac704]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:03 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066588.5128589, ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:30:03 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] VM Stopped (Lifecycle Event)
Aug 15 02:30:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-bb24210c-75ab-4688-b6e4-18c38a3afa49 None None] [instance: ce5b06e7-37f3-4bcf-b0de-7622e9b8c06f] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23965343532633238', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965343532633238', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949422126',display_name='tempest-ServerActionsTestOtherB-server-949422126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949422126',id=47,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHtT/z4+EwvsQypxm7gdMPNSlReNYTbUu3hKKgnLffbACwld+psBjNbQUUl3fZeJ92B3U1PN95LB9d30L8XORPoR9Kn5sBYGKVZpr0ZJgl63wFEoFNzSdCWjJwXJdBIRA==',key_name='tempest-keypair-1894281607',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e42e645406e44a9286cfb543f9d30064',ramdisk_id='',reservation_id='r-pxwx7fmk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1222409128',owner_user_name='tempest-ServerActionsTestOtherB-1222409128-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88947c21cb5b4c41969a408f949666c4',uuid=a8f1af9c-f6d1-4840-bf52-ba2526c558b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-675599451-network", "vif_mac": "fa:16:3e:92:6c:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converting VIF {"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-675599451-network", "vif_mac": "fa:16:3e:92:6c:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:30:04 user nova-compute[73121]:   <uuid>a8f1af9c-f6d1-4840-bf52-ba2526c558b0</uuid>
Aug 15 02:30:04 user nova-compute[73121]:   <name>instance-0000002f</name>
Aug 15 02:30:04 user nova-compute[73121]:   <memory>2097152</memory>
Aug 15 02:30:04 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:30:04 user nova-compute[73121]:   <metadata>
Aug 15 02:30:04 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:30:04 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:30:04 user nova-compute[73121]:       <nova:name>tempest-ServerActionsTestOtherB-server-949422126</nova:name>
Aug 15 02:30:04 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:30:02</nova:creationTime>
Aug 15 02:30:04 user nova-compute[73121]:       <nova:flavor name="m1.small">
Aug 15 02:30:04 user nova-compute[73121]:         <nova:memory>2048</nova:memory>
Aug 15 02:30:04 user nova-compute[73121]:         <nova:disk>20</nova:disk>
Aug 15 02:30:04 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:30:04 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:30:04 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:30:04 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:30:04 user nova-compute[73121]:       <nova:owner>
Aug 15 02:30:04 user nova-compute[73121]:         <nova:user uuid="88947c21cb5b4c41969a408f949666c4">tempest-ServerActionsTestOtherB-1222409128-project-member</nova:user>
Aug 15 02:30:04 user nova-compute[73121]:         <nova:project uuid="e42e645406e44a9286cfb543f9d30064">tempest-ServerActionsTestOtherB-1222409128</nova:project>
Aug 15 02:30:04 user nova-compute[73121]:       </nova:owner>
Aug 15 02:30:04 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:30:04 user nova-compute[73121]:       <nova:ports>
Aug 15 02:30:04 user nova-compute[73121]:         <nova:port uuid="73961bb4-e1a8-481e-9883-9dbe008a55d9">
Aug 15 02:30:04 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 02:30:04 user nova-compute[73121]:         </nova:port>
Aug 15 02:30:04 user nova-compute[73121]:       </nova:ports>
Aug 15 02:30:04 user nova-compute[73121]:     </nova:instance>
Aug 15 02:30:04 user nova-compute[73121]:   </metadata>
Aug 15 02:30:04 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:30:04 user nova-compute[73121]:     <system>
Aug 15 02:30:04 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:30:04 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:30:04 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:30:04 user nova-compute[73121]:       <entry name="serial">a8f1af9c-f6d1-4840-bf52-ba2526c558b0</entry>
Aug 15 02:30:04 user nova-compute[73121]:       <entry name="uuid">a8f1af9c-f6d1-4840-bf52-ba2526c558b0</entry>
Aug 15 02:30:04 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:30:04 user nova-compute[73121]:     </system>
Aug 15 02:30:04 user nova-compute[73121]:   </sysinfo>
Aug 15 02:30:04 user nova-compute[73121]:   <os>
Aug 15 02:30:04 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:30:04 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:30:04 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:30:04 user nova-compute[73121]:   </os>
Aug 15 02:30:04 user nova-compute[73121]:   <features>
Aug 15 02:30:04 user nova-compute[73121]:     <acpi/>
Aug 15 02:30:04 user nova-compute[73121]:     <apic/>
Aug 15 02:30:04 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:30:04 user nova-compute[73121]:   </features>
Aug 15 02:30:04 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:30:04 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:30:04 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:30:04 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:30:04 user nova-compute[73121]:   </clock>
Aug 15 02:30:04 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:30:04 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:30:04 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:30:04 user nova-compute[73121]:   </cpu>
Aug 15 02:30:04 user nova-compute[73121]:   <devices>
Aug 15 02:30:04 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:30:04 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:30:04 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk"/>
Aug 15 02:30:04 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:30:04 user nova-compute[73121]:     </disk>
Aug 15 02:30:04 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:30:04 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:30:04 user nova-compute[73121]:       <source dev="/dev/sdb"/>
Aug 15 02:30:04 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:30:04 user nova-compute[73121]:       <serial>4b86422f-248b-4cf1-80dd-3e3c448c0c1d</serial>
Aug 15 02:30:04 user nova-compute[73121]:     </disk>
Aug 15 02:30:04 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:30:04 user nova-compute[73121]:       <mac address="fa:16:3e:92:6c:c0"/>
Aug 15 02:30:04 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:30:04 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:30:04 user nova-compute[73121]:       <target dev="tap73961bb4-e1"/>
Aug 15 02:30:04 user nova-compute[73121]:     </interface>
Aug 15 02:30:04 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:30:04 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/console.log" append="off"/>
Aug 15 02:30:04 user nova-compute[73121]:     </serial>
Aug 15 02:30:04 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:30:04 user nova-compute[73121]:     <video>
Aug 15 02:30:04 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:30:04 user nova-compute[73121]:     </video>
Aug 15 02:30:04 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:30:04 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:30:04 user nova-compute[73121]:     </rng>
Aug 15 02:30:04 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:30:04 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:30:04 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:30:04 user nova-compute[73121]:     </memballoon>
Aug 15 02:30:04 user nova-compute[73121]:   </devices>
Aug 15 02:30:04 user nova-compute[73121]: </domain>
Aug 15 02:30:04 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949422126',display_name='tempest-ServerActionsTestOtherB-server-949422126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949422126',id=47,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHtT/z4+EwvsQypxm7gdMPNSlReNYTbUu3hKKgnLffbACwld+psBjNbQUUl3fZeJ92B3U1PN95LB9d30L8XORPoR9Kn5sBYGKVZpr0ZJgl63wFEoFNzSdCWjJwXJdBIRA==',key_name='tempest-keypair-1894281607',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e42e645406e44a9286cfb543f9d30064',ramdisk_id='',reservation_id='r-pxwx7fmk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1222409128',owner_user_name='tempest-ServerActionsTestOtherB-1222409128-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88947c21cb5b4c41969a408f949666c4',uuid=a8f1af9c-f6d1-4840-bf52-ba2526c558b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-675599451-network", "vif_mac": "fa:16:3e:92:6c:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converting VIF {"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-675599451-network", "vif_mac": "fa:16:3e:92:6c:c0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG os_vif [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73961bb4-e1, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73961bb4-e1, col_values=(('external_ids', {'iface-id': '73961bb4-e1a8-481e-9883-9dbe008a55d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:6c:c0', 'vm-uuid': 'a8f1af9c-f6d1-4840-bf52-ba2526c558b0'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:04 user nova-compute[73121]: INFO os_vif [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1')
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:30:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] No VIF found with MAC fa:16:3e:92:6c:c0, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:30:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-03097d1e-88e8-4066-a31d-4f0156c71b97 req-c6b1a666-2ef7-4740-90b0-bfdb422d9458 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:30:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-03097d1e-88e8-4066-a31d-4f0156c71b97 req-c6b1a666-2ef7-4740-90b0-bfdb422d9458 service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:30:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-03097d1e-88e8-4066-a31d-4f0156c71b97 req-c6b1a666-2ef7-4740-90b0-bfdb422d9458 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:30:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-03097d1e-88e8-4066-a31d-4f0156c71b97 req-c6b1a666-2ef7-4740-90b0-bfdb422d9458 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:30:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-03097d1e-88e8-4066-a31d-4f0156c71b97 req-c6b1a666-2ef7-4740-90b0-bfdb422d9458 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:30:05 user nova-compute[73121]: WARNING nova.compute.manager [req-03097d1e-88e8-4066-a31d-4f0156c71b97 req-c6b1a666-2ef7-4740-90b0-bfdb422d9458 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state active and task_state resize_finish.
Aug 15 02:30:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:06 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066591.0332403, a8f1af9c-f6d1-4840-bf52-ba2526c558b0 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:30:06 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] VM Stopped (Lifecycle Event)
Aug 15 02:30:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:06 user nova-compute[73121]: DEBUG nova.compute.manager [None req-581d7904-98e8-416a-8cf4-8716657a1f51 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066607.6445622, a8f1af9c-f6d1-4840-bf52-ba2526c558b0 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:30:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] VM Resumed (Lifecycle Event)
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:30:07 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance running successfully.
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Failed to set time: agent not configured {{(pid=73121) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-009184f2-e225-4712-8309-bca01ad1950f tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] finish_migration finished successfully. {{(pid=73121) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:30:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066607.64904, a8f1af9c-f6d1-4840-bf52-ba2526c558b0 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:30:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] VM Started (Lifecycle Event)
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-518df063-f656-491d-8ecd-92ba84a7e4af req-9571f897-273b-432f-b1e6-a2dd6cacb1f1 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:30:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-518df063-f656-491d-8ecd-92ba84a7e4af req-9571f897-273b-432f-b1e6-a2dd6cacb1f1 service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:30:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-518df063-f656-491d-8ecd-92ba84a7e4af req-9571f897-273b-432f-b1e6-a2dd6cacb1f1 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:30:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-518df063-f656-491d-8ecd-92ba84a7e4af req-9571f897-273b-432f-b1e6-a2dd6cacb1f1 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-518df063-f656-491d-8ecd-92ba84a7e4af req-9571f897-273b-432f-b1e6-a2dd6cacb1f1 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:30:07 user nova-compute[73121]: WARNING nova.compute.manager [req-518df063-f656-491d-8ecd-92ba84a7e4af req-9571f897-273b-432f-b1e6-a2dd6cacb1f1 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state active and task_state resize_finish.
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:30:07 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:30:07 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 02:30:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:36 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:36 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:36 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:36 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:30:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:30:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:30:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:30:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:30:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:30:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:30:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:30:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:30:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:30:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8361MB free_disk=25.194393157958984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Applying migration context for instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0 as it has an incoming, in-progress migration de63cdb2-9900-440e-85f1-90a831cd42db. Migration status is finished {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 02:30:46 user nova-compute[73121]: INFO nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating resource usage from migration de63cdb2-9900-440e-85f1-90a831cd42db
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 45755efe-f0af-43db-adf6-1b11505e942e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Migration de63cdb2-9900-440e-85f1-90a831cd42db is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=24GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:30:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:30:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:30:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:30:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:30:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:31:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:31:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:31:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:31:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:31:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:31:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:31:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:31:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:31:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:31:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:31:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:31:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:19 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-2935f989-eaf9-4c02-a2e5-d192cbe0bcf8 req-6d3918d6-6af3-4fbe-b43a-66a98fa1e7e4 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-changed-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-2935f989-eaf9-4c02-a2e5-d192cbe0bcf8 req-6d3918d6-6af3-4fbe-b43a-66a98fa1e7e4 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Refreshing instance network info cache due to event network-changed-763418ec-aa43-4cb0-8a6c-8d90a11de5db. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:31:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2935f989-eaf9-4c02-a2e5-d192cbe0bcf8 req-6d3918d6-6af3-4fbe-b43a-66a98fa1e7e4 service nova] Acquiring lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:31:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2935f989-eaf9-4c02-a2e5-d192cbe0bcf8 req-6d3918d6-6af3-4fbe-b43a-66a98fa1e7e4 service nova] Acquired lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:31:30 user nova-compute[73121]: DEBUG nova.network.neutron [req-2935f989-eaf9-4c02-a2e5-d192cbe0bcf8 req-6d3918d6-6af3-4fbe-b43a-66a98fa1e7e4 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Refreshing network info cache for port 763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG nova.network.neutron [req-2935f989-eaf9-4c02-a2e5-d192cbe0bcf8 req-6d3918d6-6af3-4fbe-b43a-66a98fa1e7e4 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updated VIF entry in instance network info cache for port 763418ec-aa43-4cb0-8a6c-8d90a11de5db. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG nova.network.neutron [req-2935f989-eaf9-4c02-a2e5-d192cbe0bcf8 req-6d3918d6-6af3-4fbe-b43a-66a98fa1e7e4 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating instance_info_cache with network_info: [{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2935f989-eaf9-4c02-a2e5-d192cbe0bcf8 req-6d3918d6-6af3-4fbe-b43a-66a98fa1e7e4 service nova] Releasing lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'flavor' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:31 user nova-compute[73121]: INFO nova.compute.manager [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Attaching volume 60be6845-82bd-4530-9877-ea2bfe681de7 to /dev/vdb
Aug 15 02:31:31 user nova-compute[73121]: DEBUG os_brick.utils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef449376-9e6c-4dfb-a9ec-072cba65e7ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[91383bb6-fa2b-482e-ac91-9bc7e76f969c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[37059731-faa7-459b-a00a-82a18b449a57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6dbac0-f64c-4ffd-9290-8ed076f3c364]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:31:31 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:31:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f2d4bb-2fd0-47ee-828b-f91bf6f340c2]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG os_brick.utils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:31:31 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating existing volume attachment record: 5cc23be2-0390-44ff-b178-cf675ea7ce37 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:31:32 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:36 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:36 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:31:37 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Port 73961bb4-e1a8-481e-9883-9dbe008a55d9 binding to destination host user is already ACTIVE {{(pid=73121) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquired lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Releasing lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Creating tmpfile /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/tmpk4nyen0z to verify with other compute node that the instance is on the same shared storage. {{(pid=73121) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-a7dd8f6a-1e54-4d28-8385-cd56e4a0c921 req-6121de35-2357-4575-809d-9a23c8ac5ba6 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-unplugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a7dd8f6a-1e54-4d28-8385-cd56e4a0c921 req-6121de35-2357-4575-809d-9a23c8ac5ba6 service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a7dd8f6a-1e54-4d28-8385-cd56e4a0c921 req-6121de35-2357-4575-809d-9a23c8ac5ba6 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-a7dd8f6a-1e54-4d28-8385-cd56e4a0c921 req-6121de35-2357-4575-809d-9a23c8ac5ba6 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-a7dd8f6a-1e54-4d28-8385-cd56e4a0c921 req-6121de35-2357-4575-809d-9a23c8ac5ba6 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-unplugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:40 user nova-compute[73121]: WARNING nova.compute.manager [req-a7dd8f6a-1e54-4d28-8385-cd56e4a0c921 req-6121de35-2357-4575-809d-9a23c8ac5ba6 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-unplugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state resized and task_state resize_reverting.
Aug 15 02:31:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance destroyed successfully.
Aug 15 02:31:40 user nova-compute[73121]: DEBUG nova.objects.instance [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'resources' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949422126',display_name='tempest-ServerActionsTestOtherB-server-949422126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949422126',id=47,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHtT/z4+EwvsQypxm7gdMPNSlReNYTbUu3hKKgnLffbACwld+psBjNbQUUl3fZeJ92B3U1PN95LB9d30L8XORPoR9Kn5sBYGKVZpr0ZJgl63wFEoFNzSdCWjJwXJdBIRA==',key_name='tempest-keypair-1894281607',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e42e645406e44a9286cfb543f9d30064',ramdisk_id='',reservation_id='r-pxwx7fmk',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1222409128',owner_user_name='tempest-ServerActionsTestOtherB-1222409128-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88947c21cb5b4c41969a408f949666c4',uuid=a8f1af9c-f6d1-4840-bf52-ba2526c558b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converting VIF {"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_vif [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73961bb4-e1, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:31:40 user nova-compute[73121]: INFO os_vif [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1')
Aug 15 02:31:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:31:40 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf81a48c-f14c-416d-8b3a-1c14b1391612]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9505371-e7ab-4fea-ba5d-ee09dccfc9ad]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:31:40 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:31:40 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e2037beb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[18feea24-8841-4129-ac47-cd7e3af45a8b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c8188a-1000-4186-bdea-7f73bac48eea]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6a7456-5801-4014-9f0a-84539aa5d717]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5837dc-4719-4007-b60e-a3ecd07c4d75]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2814cd26-36af-4b95-b318-6baf82f45c76]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614b6ce-9ed9-4fd8-b341-fe03b519e24f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]
Aug 15 02:31:40 user nova-compute[73121]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.
Aug 15 02:31:40 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8738da-8731-4e2b-a3ce-77b56a359c73]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] <== disconnect_volume: return (287ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:31:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updating instance_info_cache with network_info: [{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:41 user nova-compute[73121]: DEBUG nova.objects.instance [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'migration_context' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-372e7b27-14c6-4bf7-b6b7-dfa636807d8b req-afed75d0-c2b1-46f9-b5ed-9962b41f2031 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-372e7b27-14c6-4bf7-b6b7-dfa636807d8b req-afed75d0-c2b1-46f9-b5ed-9962b41f2031 service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-372e7b27-14c6-4bf7-b6b7-dfa636807d8b req-afed75d0-c2b1-46f9-b5ed-9962b41f2031 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-372e7b27-14c6-4bf7-b6b7-dfa636807d8b req-afed75d0-c2b1-46f9-b5ed-9962b41f2031 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-372e7b27-14c6-4bf7-b6b7-dfa636807d8b req-afed75d0-c2b1-46f9-b5ed-9962b41f2031 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:42 user nova-compute[73121]: WARNING nova.compute.manager [req-372e7b27-14c6-4bf7-b6b7-dfa636807d8b req-afed75d0-c2b1-46f9-b5ed-9962b41f2031 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state resized and task_state resize_reverting.
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.527s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:42 user nova-compute[73121]: INFO nova.compute.manager [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Swapping old allocation on dict_keys(['f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf']) held by migration de63cdb2-9900-440e-85f1-90a831cd42db for instance
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Overwriting current allocation {'allocations': {'f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 58}}, 'project_id': 'e42e645406e44a9286cfb543f9d30064', 'user_id': '88947c21cb5b4c41969a408f949666c4', 'consumer_generation': 1} on consumer a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquired lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:31:42 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Releasing lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG os_brick.utils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[234b57c5-b653-4f78-940e-d3c7627afcc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d65a301-61c6-411f-bf98-f8dbf8084384]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68e0a45-9407-4cb9-8735-5c49379dddf9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[56df190c-698f-4856-9f79-5dbd559cdc00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:31:43 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:31:43 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fc77fd-3d6d-43c1-bb83-12f19abe0df0]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:31:43 user nova-compute[73121]: DEBUG os_brick.utils [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:31:46 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8488MB free_disk=25.191898345947266GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 45755efe-f0af-43db-adf6-1b11505e942e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPvfNopx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:31:46 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:31:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:31:46 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:31:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:31:46 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:31:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:46 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c7e2e4-8b7c-417d-ac43-28444d70da45]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:31:47 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9ebb8c-0d29-485a-8d1b-809f5fd7d28c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7] added
Aug 15 02:31:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f9a63a-9d73-4112-9ee2-3faff59c0c47]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a62304e-b8e7-48f4-b5dd-bed41ba79f7c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPvfNopx {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HPvfNopx" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b501500c-62a1-4ae8-9a31-3e53ba687e7d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HPvfNopx'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdad320-c005-44b6-b063-1c19f2627136]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e3b720-edfc-4c2c-b64f-73d35055f9ff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:31:47 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:31:47 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:31:47 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:31:47 user nova-compute[73121]: 
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[935bddbc-9ce9-4c87-a336-4a5399be553f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7, portal: 172.16.0.220,3260]
Aug 15 02:31:47 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7, portal: 172.16.0.220,3260] successful.
Aug 15 02:31:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce6b96d-7f71-4be2-8bf2-14894d44182b]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d22310-b99f-4349-b9c6-51f502ed8745]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:31:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:31:47 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c3268-b1f1-4fee-bd5d-34a67c4c3315]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:31:47 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPvfNopx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26162333337333666', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162333337333666', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG nova.objects.instance [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'flavor' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:31:48 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:31:48 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:31:48 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:31:48 user nova-compute[73121]:   <serial>60be6845-82bd-4530-9877-ea2bfe681de7</serial>
Aug 15 02:31:48 user nova-compute[73121]: </disk>
Aug 15 02:31:48 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No VIF found with MAC fa:16:3e:d8:fb:7f, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:31:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-9d8fce4f-a430-44e2-a94f-2a0db69a87bd tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.048s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:49 user nova-compute[73121]: INFO nova.compute.manager [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Rescuing
Aug 15 02:31:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:31:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquired lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:31:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:31:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating instance_info_cache with network_info: [{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:31:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Releasing lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:31:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-50e1c05c-f905-4589-bb2e-6deb5f0fbc3e req-c372d219-b5bd-4cbf-915a-65bbcf8ba281 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-50e1c05c-f905-4589-bb2e-6deb5f0fbc3e req-c372d219-b5bd-4cbf-915a-65bbcf8ba281 service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-50e1c05c-f905-4589-bb2e-6deb5f0fbc3e req-c372d219-b5bd-4cbf-915a-65bbcf8ba281 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-50e1c05c-f905-4589-bb2e-6deb5f0fbc3e req-c372d219-b5bd-4cbf-915a-65bbcf8ba281 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG nova.compute.manager [req-50e1c05c-f905-4589-bb2e-6deb5f0fbc3e req-c372d219-b5bd-4cbf-915a-65bbcf8ba281 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:50 user nova-compute[73121]: WARNING nova.compute.manager [req-50e1c05c-f905-4589-bb2e-6deb5f0fbc3e req-c372d219-b5bd-4cbf-915a-65bbcf8ba281 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state active and task_state rescuing.
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Instance destroyed successfully.
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Attempting rescue
Aug 15 02:31:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73121) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Instance directory exists: not creating {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 02:31:50 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Creating image(s)
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG nova.objects.instance [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'trusted_certs' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.rescue {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.rescue" returned: 0 in 0.056s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:50 user nova-compute[73121]: DEBUG nova.objects.instance [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'migration_context' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Start _get_guest_xml network_info=[{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "vif_mac": "fa:16:3e:d8:fb:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'resources' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'numa_topology' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:31:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1334642393',display_name='tempest-ServerRescueNegativeTestJSON-server-1334642393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1334642393',id=48,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrBKQDhf63xKfzygFzHqTcClP3fPLPjZleMtvoqYdSNuDGoHYvBiWiUH3BSiIlLTZfeH0OF0Ry7ReviEO+9ZHPmxLI4h4oAbL/G1fFiKntcUXiEZef88ZJW7BUnjHmawQ==',key_name='tempest-keypair-1977733763',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:29:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-aezvhlip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:29:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=45755efe-f0af-43db-adf6-1b11505e942e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "vif_mac": "fa:16:3e:d8:fb:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "vif_mac": "fa:16:3e:d8:fb:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=763418ec-aa43-4cb0-8a6c-8d90a11de5db,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763418ec-aa') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'pci_devices' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:31:51 user nova-compute[73121]:   <uuid>45755efe-f0af-43db-adf6-1b11505e942e</uuid>
Aug 15 02:31:51 user nova-compute[73121]:   <name>instance-00000030</name>
Aug 15 02:31:51 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:31:51 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:31:51 user nova-compute[73121]:   <metadata>
Aug 15 02:31:51 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:31:51 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:31:51 user nova-compute[73121]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1334642393</nova:name>
Aug 15 02:31:51 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:31:51</nova:creationTime>
Aug 15 02:31:51 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:31:51 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:31:51 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:31:51 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:31:51 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:31:51 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:31:51 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:31:51 user nova-compute[73121]:       <nova:owner>
Aug 15 02:31:51 user nova-compute[73121]:         <nova:user uuid="c5012859ad374ac0b441cc5a5739cf4e">tempest-ServerRescueNegativeTestJSON-704093322-project-member</nova:user>
Aug 15 02:31:51 user nova-compute[73121]:         <nova:project uuid="c202114f5c584284a72d52cececc4b34">tempest-ServerRescueNegativeTestJSON-704093322</nova:project>
Aug 15 02:31:51 user nova-compute[73121]:       </nova:owner>
Aug 15 02:31:51 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:31:51 user nova-compute[73121]:       <nova:ports>
Aug 15 02:31:51 user nova-compute[73121]:         <nova:port uuid="763418ec-aa43-4cb0-8a6c-8d90a11de5db">
Aug 15 02:31:51 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 02:31:51 user nova-compute[73121]:         </nova:port>
Aug 15 02:31:51 user nova-compute[73121]:       </nova:ports>
Aug 15 02:31:51 user nova-compute[73121]:     </nova:instance>
Aug 15 02:31:51 user nova-compute[73121]:   </metadata>
Aug 15 02:31:51 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:31:51 user nova-compute[73121]:     <system>
Aug 15 02:31:51 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:31:51 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:31:51 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:31:51 user nova-compute[73121]:       <entry name="serial">45755efe-f0af-43db-adf6-1b11505e942e</entry>
Aug 15 02:31:51 user nova-compute[73121]:       <entry name="uuid">45755efe-f0af-43db-adf6-1b11505e942e</entry>
Aug 15 02:31:51 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:31:51 user nova-compute[73121]:     </system>
Aug 15 02:31:51 user nova-compute[73121]:   </sysinfo>
Aug 15 02:31:51 user nova-compute[73121]:   <os>
Aug 15 02:31:51 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:31:51 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:31:51 user nova-compute[73121]:   </os>
Aug 15 02:31:51 user nova-compute[73121]:   <features>
Aug 15 02:31:51 user nova-compute[73121]:     <acpi/>
Aug 15 02:31:51 user nova-compute[73121]:     <apic/>
Aug 15 02:31:51 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:31:51 user nova-compute[73121]:   </features>
Aug 15 02:31:51 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:31:51 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:31:51 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:31:51 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:31:51 user nova-compute[73121]:   </clock>
Aug 15 02:31:51 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:31:51 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:31:51 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:31:51 user nova-compute[73121]:   </cpu>
Aug 15 02:31:51 user nova-compute[73121]:   <devices>
Aug 15 02:31:51 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:31:51 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:31:51 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.rescue"/>
Aug 15 02:31:51 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:31:51 user nova-compute[73121]:     </disk>
Aug 15 02:31:51 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:31:51 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:31:51 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk"/>
Aug 15 02:31:51 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:31:51 user nova-compute[73121]:     </disk>
Aug 15 02:31:51 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:31:51 user nova-compute[73121]:       <mac address="fa:16:3e:d8:fb:7f"/>
Aug 15 02:31:51 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:31:51 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:31:51 user nova-compute[73121]:       <target dev="tap763418ec-aa"/>
Aug 15 02:31:51 user nova-compute[73121]:     </interface>
Aug 15 02:31:51 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:31:51 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/console.log" append="off"/>
Aug 15 02:31:51 user nova-compute[73121]:     </serial>
Aug 15 02:31:51 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:31:51 user nova-compute[73121]:     <video>
Aug 15 02:31:51 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:31:51 user nova-compute[73121]:     </video>
Aug 15 02:31:51 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:31:51 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:31:51 user nova-compute[73121]:     </rng>
Aug 15 02:31:51 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:31:51 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:31:51 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:31:51 user nova-compute[73121]:     </memballoon>
Aug 15 02:31:51 user nova-compute[73121]:   </devices>
Aug 15 02:31:51 user nova-compute[73121]: </domain>
Aug 15 02:31:51 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:31:51 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Instance destroyed successfully.
Aug 15 02:31:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:31:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] No VIF found with MAC fa:16:3e:d8:fb:7f, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:52 user nova-compute[73121]: WARNING nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state active and task_state rescuing.
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:52 user nova-compute[73121]: WARNING nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state active and task_state rescuing.
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:52 user nova-compute[73121]: WARNING nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state active and task_state rescuing.
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:52 user nova-compute[73121]: WARNING nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state active and task_state rescuing.
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:52 user nova-compute[73121]: WARNING nova.compute.manager [req-ccd58923-174e-411e-a768-aa015c7e68c4 req-38b9b9ae-d904-452b-bbfa-599d9798f19d service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state active and task_state rescuing.
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Starting finish_revert_migration {{(pid=73121) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Start _get_guest_xml network_info=[{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'boot_index': None, 'delete_on_termination': False, 'disk_bus': 'virtio', 'device_type': 'disk', 'attachment_id': 'ce4a31ff-420f-449a-a338-6f7c339ae379', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a8f1af9c-f6d1-4840-bf52-ba2526c558b0', 'attached_at': '2023-08-15T02:31:52.000000', 'detached_at': '', 'volume_id': '4b86422f-248b-4cf1-80dd-3e3c448c0c1d', 'serial': '4b86422f-248b-4cf1-80dd-3e3c448c0c1d'}, 'guest_format': None, 'volume_type': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:31:52 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:31:52 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.objects.instance [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'vcpu_model' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:31:52 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:31:52 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:31:52 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:31:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f949ab0-f97c-4ccb-ba07-2e32dde7ca31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:31:52 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cab636-03fb-4abb-9140-632cf092ff36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d] added
Aug 15 02:31:52 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf938da-ee1a-4d95-bb58-d44c50d74dbf]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[72610ecb-70e4-42c4-bbe1-25b420e4af0d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjAuvDRS {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjAuvDRS" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de9e005-d1e4-4221-a5c2-d397c476ddf5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cjAuvDRS'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85ecc9b-0f5f-4469-a108-240aa3b8a821]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdcab61-fca8-4589-9e04-986e5b879e08]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:31:52 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:31:52 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[80671dd8-307b-44c9-a6a6-e664f46f3af8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]
Aug 15 02:31:52 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.
Aug 15 02:31:52 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1ad1ea-3429-4c89-8c5f-64cc528128d5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee5ec94-6f54-4921-b3bc-b8b867c26c2b]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:31:52 user nova-compute[73121]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:31:52 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:31:52 user nova-compute[73121]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:31:52 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada8b8d5-fc3f-46a0-8c79-5828c5cc86e8]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:31:52 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23965343532633238', 'path': '/dev/sdc'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965343532633238', 'path': '/dev/sdc'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949422126',display_name='tempest-ServerActionsTestOtherB-server-949422126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949422126',id=47,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHtT/z4+EwvsQypxm7gdMPNSlReNYTbUu3hKKgnLffbACwld+psBjNbQUUl3fZeJ92B3U1PN95LB9d30L8XORPoR9Kn5sBYGKVZpr0ZJgl63wFEoFNzSdCWjJwXJdBIRA==',key_name='tempest-keypair-1894281607',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e42e645406e44a9286cfb543f9d30064',ramdisk_id='',reservation_id='r-pxwx7fmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1222409128',owner_user_name='tempest-ServerActionsTestOtherB-1222409128-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:31:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88947c21cb5b4c41969a408f949666c4',uuid=a8f1af9c-f6d1-4840-bf52-ba2526c558b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converting VIF {"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:31:53 user nova-compute[73121]:   <uuid>a8f1af9c-f6d1-4840-bf52-ba2526c558b0</uuid>
Aug 15 02:31:53 user nova-compute[73121]:   <name>instance-0000002f</name>
Aug 15 02:31:53 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:31:53 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:31:53 user nova-compute[73121]:   <metadata>
Aug 15 02:31:53 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:31:53 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:31:53 user nova-compute[73121]:       <nova:name>tempest-ServerActionsTestOtherB-server-949422126</nova:name>
Aug 15 02:31:53 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:31:52</nova:creationTime>
Aug 15 02:31:53 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:31:53 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:31:53 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:31:53 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:31:53 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:31:53 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:31:53 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:31:53 user nova-compute[73121]:       <nova:owner>
Aug 15 02:31:53 user nova-compute[73121]:         <nova:user uuid="88947c21cb5b4c41969a408f949666c4">tempest-ServerActionsTestOtherB-1222409128-project-member</nova:user>
Aug 15 02:31:53 user nova-compute[73121]:         <nova:project uuid="e42e645406e44a9286cfb543f9d30064">tempest-ServerActionsTestOtherB-1222409128</nova:project>
Aug 15 02:31:53 user nova-compute[73121]:       </nova:owner>
Aug 15 02:31:53 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:31:53 user nova-compute[73121]:       <nova:ports>
Aug 15 02:31:53 user nova-compute[73121]:         <nova:port uuid="73961bb4-e1a8-481e-9883-9dbe008a55d9">
Aug 15 02:31:53 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 02:31:53 user nova-compute[73121]:         </nova:port>
Aug 15 02:31:53 user nova-compute[73121]:       </nova:ports>
Aug 15 02:31:53 user nova-compute[73121]:     </nova:instance>
Aug 15 02:31:53 user nova-compute[73121]:   </metadata>
Aug 15 02:31:53 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:31:53 user nova-compute[73121]:     <system>
Aug 15 02:31:53 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:31:53 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:31:53 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:31:53 user nova-compute[73121]:       <entry name="serial">a8f1af9c-f6d1-4840-bf52-ba2526c558b0</entry>
Aug 15 02:31:53 user nova-compute[73121]:       <entry name="uuid">a8f1af9c-f6d1-4840-bf52-ba2526c558b0</entry>
Aug 15 02:31:53 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:31:53 user nova-compute[73121]:     </system>
Aug 15 02:31:53 user nova-compute[73121]:   </sysinfo>
Aug 15 02:31:53 user nova-compute[73121]:   <os>
Aug 15 02:31:53 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:31:53 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:31:53 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:31:53 user nova-compute[73121]:   </os>
Aug 15 02:31:53 user nova-compute[73121]:   <features>
Aug 15 02:31:53 user nova-compute[73121]:     <acpi/>
Aug 15 02:31:53 user nova-compute[73121]:     <apic/>
Aug 15 02:31:53 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:31:53 user nova-compute[73121]:   </features>
Aug 15 02:31:53 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:31:53 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:31:53 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:31:53 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:31:53 user nova-compute[73121]:   </clock>
Aug 15 02:31:53 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:31:53 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:31:53 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:31:53 user nova-compute[73121]:   </cpu>
Aug 15 02:31:53 user nova-compute[73121]:   <devices>
Aug 15 02:31:53 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:31:53 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:31:53 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk"/>
Aug 15 02:31:53 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:31:53 user nova-compute[73121]:     </disk>
Aug 15 02:31:53 user nova-compute[73121]:     <disk type="block" device="disk">
Aug 15 02:31:53 user nova-compute[73121]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:31:53 user nova-compute[73121]:       <source dev="/dev/sdc"/>
Aug 15 02:31:53 user nova-compute[73121]:       <target dev="vdb" bus="virtio"/>
Aug 15 02:31:53 user nova-compute[73121]:       <serial>4b86422f-248b-4cf1-80dd-3e3c448c0c1d</serial>
Aug 15 02:31:53 user nova-compute[73121]:     </disk>
Aug 15 02:31:53 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:31:53 user nova-compute[73121]:       <mac address="fa:16:3e:92:6c:c0"/>
Aug 15 02:31:53 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:31:53 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:31:53 user nova-compute[73121]:       <target dev="tap73961bb4-e1"/>
Aug 15 02:31:53 user nova-compute[73121]:     </interface>
Aug 15 02:31:53 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:31:53 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/console.log" append="off"/>
Aug 15 02:31:53 user nova-compute[73121]:     </serial>
Aug 15 02:31:53 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:31:53 user nova-compute[73121]:     <video>
Aug 15 02:31:53 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:31:53 user nova-compute[73121]:     </video>
Aug 15 02:31:53 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:31:53 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:31:53 user nova-compute[73121]:     </rng>
Aug 15 02:31:53 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:31:53 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:31:53 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:31:53 user nova-compute[73121]:     </memballoon>
Aug 15 02:31:53 user nova-compute[73121]:   </devices>
Aug 15 02:31:53 user nova-compute[73121]: </domain>
Aug 15 02:31:53 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949422126',display_name='tempest-ServerActionsTestOtherB-server-949422126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949422126',id=47,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHtT/z4+EwvsQypxm7gdMPNSlReNYTbUu3hKKgnLffbACwld+psBjNbQUUl3fZeJ92B3U1PN95LB9d30L8XORPoR9Kn5sBYGKVZpr0ZJgl63wFEoFNzSdCWjJwXJdBIRA==',key_name='tempest-keypair-1894281607',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:30:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e42e645406e44a9286cfb543f9d30064',ramdisk_id='',reservation_id='r-pxwx7fmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1222409128',owner_user_name='tempest-ServerActionsTestOtherB-1222409128-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:31:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88947c21cb5b4c41969a408f949666c4',uuid=a8f1af9c-f6d1-4840-bf52-ba2526c558b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converting VIF {"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG os_vif [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73961bb4-e1, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73961bb4-e1, col_values=(('external_ids', {'iface-id': '73961bb4-e1a8-481e-9883-9dbe008a55d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:6c:c0', 'vm-uuid': 'a8f1af9c-f6d1-4840-bf52-ba2526c558b0'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:31:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:53 user nova-compute[73121]: INFO os_vif [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1')
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:54 user nova-compute[73121]: WARNING nova.compute.manager [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state active and task_state rescuing.
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.compute.manager [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:54 user nova-compute[73121]: WARNING nova.compute.manager [req-eb7d9db5-81e7-4745-8cd3-f99c9380eadc req-23cb0eb9-e5a6-40e5-9dd0-85924e6fe99c service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state active and task_state rescuing.
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for 45755efe-f0af-43db-adf6-1b11505e942e due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066714.7347794, 45755efe-f0af-43db-adf6-1b11505e942e => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:31:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] VM Resumed (Lifecycle Event)
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-1b52ac31-a456-488c-bdd5-556979bb696b tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:31:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066714.7349005, 45755efe-f0af-43db-adf6-1b11505e942e => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:31:54 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] VM Started (Lifecycle Event)
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:31:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-c5bc4128-ccda-4ea0-ac3c-9edb375f37bb req-80e19684-b651-48ee-95f0-e1d7ece99f3c service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c5bc4128-ccda-4ea0-ac3c-9edb375f37bb req-80e19684-b651-48ee-95f0-e1d7ece99f3c service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c5bc4128-ccda-4ea0-ac3c-9edb375f37bb req-80e19684-b651-48ee-95f0-e1d7ece99f3c service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c5bc4128-ccda-4ea0-ac3c-9edb375f37bb req-80e19684-b651-48ee-95f0-e1d7ece99f3c service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG nova.compute.manager [req-c5bc4128-ccda-4ea0-ac3c-9edb375f37bb req-80e19684-b651-48ee-95f0-e1d7ece99f3c service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:55 user nova-compute[73121]: WARNING nova.compute.manager [req-c5bc4128-ccda-4ea0-ac3c-9edb375f37bb req-80e19684-b651-48ee-95f0-e1d7ece99f3c service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state resized and task_state resize_reverting.
Aug 15 02:31:55 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066700.6353025, a8f1af9c-f6d1-4840-bf52-ba2526c558b0 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:31:55 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] VM Stopped (Lifecycle Event)
Aug 15 02:31:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-585c60ab-5859-4268-b491-dfd98b6b9565 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066717.4695163, a8f1af9c-f6d1-4840-bf52-ba2526c558b0 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:31:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] VM Resumed (Lifecycle Event)
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:31:57 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance running successfully.
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] finish_revert_migration finished successfully. {{(pid=73121) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-e3a74920-39f4-44fb-b880-9d795056106a req-6a50de5e-17c1-4e14-a359-38df37088fff service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:31:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e3a74920-39f4-44fb-b880-9d795056106a req-6a50de5e-17c1-4e14-a359-38df37088fff service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:31:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e3a74920-39f4-44fb-b880-9d795056106a req-6a50de5e-17c1-4e14-a359-38df37088fff service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:31:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e3a74920-39f4-44fb-b880-9d795056106a req-6a50de5e-17c1-4e14-a359-38df37088fff service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.compute.manager [req-e3a74920-39f4-44fb-b880-9d795056106a req-6a50de5e-17c1-4e14-a359-38df37088fff service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:31:57 user nova-compute[73121]: WARNING nova.compute.manager [req-e3a74920-39f4-44fb-b880-9d795056106a req-6a50de5e-17c1-4e14-a359-38df37088fff service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state resized and task_state resize_reverting.
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:31:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066717.4744542, a8f1af9c-f6d1-4840-bf52-ba2526c558b0 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:31:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] VM Started (Lifecycle Event)
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:31:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:31:57 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 02:31:57 user nova-compute[73121]: INFO nova.compute.manager [None req-fb0e60b9-6fdf-4159-9340-2ea9e0e48fa7 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance to original state: 'active'
Aug 15 02:31:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:31:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:32:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:32:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:32:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:32:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:32:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:34 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:32:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:32:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:32:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:32:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:32:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:32:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:32:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:32:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:32:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:32:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updating instance_info_cache with network_info: [{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:32:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:32:47 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:32:47 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8362MB free_disk=25.20867919921875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 45755efe-f0af-43db-adf6-1b11505e942e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:32:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:32:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:32:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:32:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:32:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:32:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:32:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:33:01 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:33:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:33:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:33:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:33:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:33:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:36 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:33:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:40 user nova-compute[73121]: INFO nova.compute.manager [None req-0c4ae91d-5a7d-4970-aefe-6f2954324cdf tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Unrescuing
Aug 15 02:33:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0c4ae91d-5a7d-4970-aefe-6f2954324cdf tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:33:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0c4ae91d-5a7d-4970-aefe-6f2954324cdf tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquired lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:33:40 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0c4ae91d-5a7d-4970-aefe-6f2954324cdf tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:33:40 user nova-compute[73121]: DEBUG nova.network.neutron [None req-0c4ae91d-5a7d-4970-aefe-6f2954324cdf tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating instance_info_cache with network_info: [{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:33:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-0c4ae91d-5a7d-4970-aefe-6f2954324cdf tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Releasing lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:33:40 user nova-compute[73121]: DEBUG nova.objects.instance [None req-0c4ae91d-5a7d-4970-aefe-6f2954324cdf tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'flavor' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:33:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-bc7dd002-4528-496c-afcb-47947254fd99 req-d3e07e2e-6962-4bef-be01-48f0899a5905 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:33:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bc7dd002-4528-496c-afcb-47947254fd99 req-d3e07e2e-6962-4bef-be01-48f0899a5905 service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:33:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bc7dd002-4528-496c-afcb-47947254fd99 req-d3e07e2e-6962-4bef-be01-48f0899a5905 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:33:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bc7dd002-4528-496c-afcb-47947254fd99 req-d3e07e2e-6962-4bef-be01-48f0899a5905 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:33:41 user nova-compute[73121]: DEBUG nova.compute.manager [req-bc7dd002-4528-496c-afcb-47947254fd99 req-d3e07e2e-6962-4bef-be01-48f0899a5905 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:33:41 user nova-compute[73121]: WARNING nova.compute.manager [req-bc7dd002-4528-496c-afcb-47947254fd99 req-d3e07e2e-6962-4bef-be01-48f0899a5905 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:33:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:41 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Instance destroyed successfully.
Aug 15 02:33:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:33:43 user nova-compute[73121]: WARNING nova.compute.manager [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:33:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:33:43 user nova-compute[73121]: DEBUG nova.compute.manager [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:33:43 user nova-compute[73121]: WARNING nova.compute.manager [req-0093a2a7-5808-41f0-9820-a91e8bd035c4 req-8a7244f2-2664-4c2c-959d-d67d75837a41 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state rescued and task_state unrescuing.
Aug 15 02:33:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:33:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:33:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:33:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:33:44 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [{"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:33:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-a8f1af9c-f6d1-4840-bf52-ba2526c558b0" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:33:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:33:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Removed pending event for 45755efe-f0af-43db-adf6-1b11505e942e due to event {{(pid=73121) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066825.0833392, 45755efe-f0af-43db-adf6-1b11505e942e => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:33:45 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] VM Resumed (Lifecycle Event)
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0c4ae91d-5a7d-4970-aefe-6f2954324cdf tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:33:45 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066825.0845425, 45755efe-f0af-43db-adf6-1b11505e942e => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:33:45 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] VM Started (Lifecycle Event)
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-6820b23e-f263-4347-8e84-b4cd430140bd req-ba972dff-3879-4a7e-8c14-5689e6f4c87f service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6820b23e-f263-4347-8e84-b4cd430140bd req-ba972dff-3879-4a7e-8c14-5689e6f4c87f service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6820b23e-f263-4347-8e84-b4cd430140bd req-ba972dff-3879-4a7e-8c14-5689e6f4c87f service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6820b23e-f263-4347-8e84-b4cd430140bd req-ba972dff-3879-4a7e-8c14-5689e6f4c87f service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.compute.manager [req-6820b23e-f263-4347-8e84-b4cd430140bd req-ba972dff-3879-4a7e-8c14-5689e6f4c87f service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:33:45 user nova-compute[73121]: WARNING nova.compute.manager [req-6820b23e-f263-4347-8e84-b4cd430140bd req-ba972dff-3879-4a7e-8c14-5689e6f4c87f service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state active and task_state None.
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:33:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:33:47 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:33:47 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:33:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8474MB free_disk=25.206817626953125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:33:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:33:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 45755efe-f0af-43db-adf6-1b11505e942e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:33:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:34:00 user nova-compute[73121]: INFO nova.compute.claims [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Claim successful on node user
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.261s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:34:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.policy [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '653e644c87c64416b9ae9e8ac7fa00c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4a5f286c3484342930ee93aff3215c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:34:00 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Creating image(s)
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "/opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "/opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "/opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk 1073741824" returned: 0 in 0.060s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Successfully created port: 59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Cannot resize image /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lazy-loading 'migration_context' on Instance uuid d25460df-911c-4b29-892e-89747d40d6b2 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Ensure instance console log exists: /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Successfully updated port: 59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "refresh_cache-d25460df-911c-4b29-892e-89747d40d6b2" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquired lock "refresh_cache-d25460df-911c-4b29-892e-89747d40d6b2" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-1e1601ed-d6a3-41f7-90d7-834004875c50 req-ac36682f-e2d0-4ece-b4ab-5f2a6b5c5987 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received event network-changed-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.compute.manager [req-1e1601ed-d6a3-41f7-90d7-834004875c50 req-ac36682f-e2d0-4ece-b4ab-5f2a6b5c5987 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Refreshing instance network info cache due to event network-changed-59d20bfa-413d-4c52-a403-4a682b673db6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1e1601ed-d6a3-41f7-90d7-834004875c50 req-ac36682f-e2d0-4ece-b4ab-5f2a6b5c5987 service nova] Acquiring lock "refresh_cache-d25460df-911c-4b29-892e-89747d40d6b2" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:34:01 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Updating instance_info_cache with network_info: [{"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Releasing lock "refresh_cache-d25460df-911c-4b29-892e-89747d40d6b2" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Instance network_info: |[{"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1e1601ed-d6a3-41f7-90d7-834004875c50 req-ac36682f-e2d0-4ece-b4ab-5f2a6b5c5987 service nova] Acquired lock "refresh_cache-d25460df-911c-4b29-892e-89747d40d6b2" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.network.neutron [req-1e1601ed-d6a3-41f7-90d7-834004875c50 req-ac36682f-e2d0-4ece-b4ab-5f2a6b5c5987 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Refreshing network info cache for port 59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Start _get_guest_xml network_info=[{"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:34:02 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:34:02 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1237155660',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1237155660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1237155',id=49,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmZsUnebyrnZcIox54pEnx05v/SjPiW6ihKjawaFnwFCxrjGM+DkFXpZR4MWyjXlad9ITKnGOCo07X/dL5v5Q9z53huto47YLHRlO1FcYs1Ab2NuqdUIotWjq9oLkgPNQ==',key_name='tempest-keypair-706072691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4a5f286c3484342930ee93aff3215c1',ramdisk_id='',reservation_id='r-g0603sjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1001782466',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='653e644c87c64416b9ae9e8ac7fa00c3',uuid=d25460df-911c-4b29-892e-89747d40d6b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Converting VIF {"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:69:25,bridge_name='br-int',has_traffic_filtering=True,id=59d20bfa-413d-4c52-a403-4a682b673db6,network=Network(3ac3296c-7df6-442b-a9ae-e9edb8804412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d20bfa-41') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lazy-loading 'pci_devices' on Instance uuid d25460df-911c-4b29-892e-89747d40d6b2 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:34:02 user nova-compute[73121]:   <uuid>d25460df-911c-4b29-892e-89747d40d6b2</uuid>
Aug 15 02:34:02 user nova-compute[73121]:   <name>instance-00000031</name>
Aug 15 02:34:02 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:34:02 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:34:02 user nova-compute[73121]:   <metadata>
Aug 15 02:34:02 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:34:02 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:34:02 user nova-compute[73121]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1237155660</nova:name>
Aug 15 02:34:02 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:34:02</nova:creationTime>
Aug 15 02:34:02 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:34:02 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:34:02 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:34:02 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:34:02 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:34:02 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:34:02 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:34:02 user nova-compute[73121]:       <nova:owner>
Aug 15 02:34:02 user nova-compute[73121]:         <nova:user uuid="653e644c87c64416b9ae9e8ac7fa00c3">tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member</nova:user>
Aug 15 02:34:02 user nova-compute[73121]:         <nova:project uuid="d4a5f286c3484342930ee93aff3215c1">tempest-TestServerVolumeAttachScenarioOldVersion-1001782466</nova:project>
Aug 15 02:34:02 user nova-compute[73121]:       </nova:owner>
Aug 15 02:34:02 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:34:02 user nova-compute[73121]:       <nova:ports>
Aug 15 02:34:02 user nova-compute[73121]:         <nova:port uuid="59d20bfa-413d-4c52-a403-4a682b673db6">
Aug 15 02:34:02 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 02:34:02 user nova-compute[73121]:         </nova:port>
Aug 15 02:34:02 user nova-compute[73121]:       </nova:ports>
Aug 15 02:34:02 user nova-compute[73121]:     </nova:instance>
Aug 15 02:34:02 user nova-compute[73121]:   </metadata>
Aug 15 02:34:02 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:34:02 user nova-compute[73121]:     <system>
Aug 15 02:34:02 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:34:02 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:34:02 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:34:02 user nova-compute[73121]:       <entry name="serial">d25460df-911c-4b29-892e-89747d40d6b2</entry>
Aug 15 02:34:02 user nova-compute[73121]:       <entry name="uuid">d25460df-911c-4b29-892e-89747d40d6b2</entry>
Aug 15 02:34:02 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:34:02 user nova-compute[73121]:     </system>
Aug 15 02:34:02 user nova-compute[73121]:   </sysinfo>
Aug 15 02:34:02 user nova-compute[73121]:   <os>
Aug 15 02:34:02 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:34:02 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:34:02 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:34:02 user nova-compute[73121]:   </os>
Aug 15 02:34:02 user nova-compute[73121]:   <features>
Aug 15 02:34:02 user nova-compute[73121]:     <acpi/>
Aug 15 02:34:02 user nova-compute[73121]:     <apic/>
Aug 15 02:34:02 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:34:02 user nova-compute[73121]:   </features>
Aug 15 02:34:02 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:34:02 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:34:02 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:34:02 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:34:02 user nova-compute[73121]:   </clock>
Aug 15 02:34:02 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:34:02 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:34:02 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:34:02 user nova-compute[73121]:   </cpu>
Aug 15 02:34:02 user nova-compute[73121]:   <devices>
Aug 15 02:34:02 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:34:02 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:34:02 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk"/>
Aug 15 02:34:02 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:34:02 user nova-compute[73121]:     </disk>
Aug 15 02:34:02 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:34:02 user nova-compute[73121]:       <mac address="fa:16:3e:97:69:25"/>
Aug 15 02:34:02 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:34:02 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:34:02 user nova-compute[73121]:       <target dev="tap59d20bfa-41"/>
Aug 15 02:34:02 user nova-compute[73121]:     </interface>
Aug 15 02:34:02 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:34:02 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/console.log" append="off"/>
Aug 15 02:34:02 user nova-compute[73121]:     </serial>
Aug 15 02:34:02 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:34:02 user nova-compute[73121]:     <video>
Aug 15 02:34:02 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:34:02 user nova-compute[73121]:     </video>
Aug 15 02:34:02 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:34:02 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:34:02 user nova-compute[73121]:     </rng>
Aug 15 02:34:02 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:34:02 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:34:02 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:34:02 user nova-compute[73121]:     </memballoon>
Aug 15 02:34:02 user nova-compute[73121]:   </devices>
Aug 15 02:34:02 user nova-compute[73121]: </domain>
Aug 15 02:34:02 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1237155660',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1237155660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1237155',id=49,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmZsUnebyrnZcIox54pEnx05v/SjPiW6ihKjawaFnwFCxrjGM+DkFXpZR4MWyjXlad9ITKnGOCo07X/dL5v5Q9z53huto47YLHRlO1FcYs1Ab2NuqdUIotWjq9oLkgPNQ==',key_name='tempest-keypair-706072691',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d4a5f286c3484342930ee93aff3215c1',ramdisk_id='',reservation_id='r-g0603sjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1001782466',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:34:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='653e644c87c64416b9ae9e8ac7fa00c3',uuid=d25460df-911c-4b29-892e-89747d40d6b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Converting VIF {"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:69:25,bridge_name='br-int',has_traffic_filtering=True,id=59d20bfa-413d-4c52-a403-4a682b673db6,network=Network(3ac3296c-7df6-442b-a9ae-e9edb8804412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d20bfa-41') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG os_vif [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:69:25,bridge_name='br-int',has_traffic_filtering=True,id=59d20bfa-413d-4c52-a403-4a682b673db6,network=Network(3ac3296c-7df6-442b-a9ae-e9edb8804412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d20bfa-41') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59d20bfa-41, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59d20bfa-41, col_values=(('external_ids', {'iface-id': '59d20bfa-413d-4c52-a403-4a682b673db6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:69:25', 'vm-uuid': 'd25460df-911c-4b29-892e-89747d40d6b2'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:02 user nova-compute[73121]: INFO os_vif [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:69:25,bridge_name='br-int',has_traffic_filtering=True,id=59d20bfa-413d-4c52-a403-4a682b673db6,network=Network(3ac3296c-7df6-442b-a9ae-e9edb8804412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d20bfa-41')
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] No VIF found with MAC fa:16:3e:97:69:25, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.network.neutron [req-1e1601ed-d6a3-41f7-90d7-834004875c50 req-ac36682f-e2d0-4ece-b4ab-5f2a6b5c5987 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Updated VIF entry in instance network info cache for port 59d20bfa-413d-4c52-a403-4a682b673db6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG nova.network.neutron [req-1e1601ed-d6a3-41f7-90d7-834004875c50 req-ac36682f-e2d0-4ece-b4ab-5f2a6b5c5987 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Updating instance_info_cache with network_info: [{"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:34:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1e1601ed-d6a3-41f7-90d7-834004875c50 req-ac36682f-e2d0-4ece-b4ab-5f2a6b5c5987 service nova] Releasing lock "refresh_cache-d25460df-911c-4b29-892e-89747d40d6b2" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:34:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:04 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-0e705a5c-e1d0-4833-9e66-60120fa0a6da req-5961b87d-370e-4a3d-a055-b4b08a7871ee service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received event network-vif-plugged-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:34:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0e705a5c-e1d0-4833-9e66-60120fa0a6da req-5961b87d-370e-4a3d-a055-b4b08a7871ee service nova] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0e705a5c-e1d0-4833-9e66-60120fa0a6da req-5961b87d-370e-4a3d-a055-b4b08a7871ee service nova] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0e705a5c-e1d0-4833-9e66-60120fa0a6da req-5961b87d-370e-4a3d-a055-b4b08a7871ee service nova] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-0e705a5c-e1d0-4833-9e66-60120fa0a6da req-5961b87d-370e-4a3d-a055-b4b08a7871ee service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] No waiting events found dispatching network-vif-plugged-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:34:04 user nova-compute[73121]: WARNING nova.compute.manager [req-0e705a5c-e1d0-4833-9e66-60120fa0a6da req-5961b87d-370e-4a3d-a055-b4b08a7871ee service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received unexpected event network-vif-plugged-59d20bfa-413d-4c52-a403-4a682b673db6 for instance with vm_state building and task_state spawning.
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066845.7653356, d25460df-911c-4b29-892e-89747d40d6b2 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:34:05 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d25460df-911c-4b29-892e-89747d40d6b2] VM Resumed (Lifecycle Event)
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:34:05 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Instance spawned successfully.
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:34:05 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d25460df-911c-4b29-892e-89747d40d6b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066845.7654974, d25460df-911c-4b29-892e-89747d40d6b2 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:34:05 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d25460df-911c-4b29-892e-89747d40d6b2] VM Started (Lifecycle Event)
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:34:05 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: d25460df-911c-4b29-892e-89747d40d6b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:34:05 user nova-compute[73121]: INFO nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Took 5.30 seconds to spawn the instance on the hypervisor.
Aug 15 02:34:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:34:06 user nova-compute[73121]: INFO nova.compute.manager [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Took 5.94 seconds to build instance.
Aug 15 02:34:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e71ab33e-4a6b-4230-8e49-b59b381855c6 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.040s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-c1cf1b2c-2e2d-4e3a-ba63-2b9c56a0bb35 req-c58843a6-166e-49a5-92c9-547c08b883ae service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received event network-vif-plugged-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:34:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c1cf1b2c-2e2d-4e3a-ba63-2b9c56a0bb35 req-c58843a6-166e-49a5-92c9-547c08b883ae service nova] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c1cf1b2c-2e2d-4e3a-ba63-2b9c56a0bb35 req-c58843a6-166e-49a5-92c9-547c08b883ae service nova] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-c1cf1b2c-2e2d-4e3a-ba63-2b9c56a0bb35 req-c58843a6-166e-49a5-92c9-547c08b883ae service nova] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-c1cf1b2c-2e2d-4e3a-ba63-2b9c56a0bb35 req-c58843a6-166e-49a5-92c9-547c08b883ae service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] No waiting events found dispatching network-vif-plugged-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:34:06 user nova-compute[73121]: WARNING nova.compute.manager [req-c1cf1b2c-2e2d-4e3a-ba63-2b9c56a0bb35 req-c58843a6-166e-49a5-92c9-547c08b883ae service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received unexpected event network-vif-plugged-59d20bfa-413d-4c52-a403-4a682b673db6 for instance with vm_state active and task_state None.
Aug 15 02:34:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:34:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:30 user nova-compute[73121]: INFO nova.compute.manager [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Terminating instance
Aug 15 02:34:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-ec0562b5-eb00-428f-a38a-60a2531faeb4 req-3e69bb31-faaf-4d2f-bcac-5c3623c2973b service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-unplugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ec0562b5-eb00-428f-a38a-60a2531faeb4 req-3e69bb31-faaf-4d2f-bcac-5c3623c2973b service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ec0562b5-eb00-428f-a38a-60a2531faeb4 req-3e69bb31-faaf-4d2f-bcac-5c3623c2973b service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ec0562b5-eb00-428f-a38a-60a2531faeb4 req-3e69bb31-faaf-4d2f-bcac-5c3623c2973b service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-ec0562b5-eb00-428f-a38a-60a2531faeb4 req-3e69bb31-faaf-4d2f-bcac-5c3623c2973b service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-unplugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:34:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-ec0562b5-eb00-428f-a38a-60a2531faeb4 req-3e69bb31-faaf-4d2f-bcac-5c3623c2973b service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-unplugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:34:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Instance destroyed successfully.
Aug 15 02:34:31 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lazy-loading 'resources' on Instance uuid a8f1af9c-f6d1-4840-bf52-ba2526c558b0 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:25:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-949422126',display_name='tempest-ServerActionsTestOtherB-server-949422126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-949422126',id=47,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHtT/z4+EwvsQypxm7gdMPNSlReNYTbUu3hKKgnLffbACwld+psBjNbQUUl3fZeJ92B3U1PN95LB9d30L8XORPoR9Kn5sBYGKVZpr0ZJgl63wFEoFNzSdCWjJwXJdBIRA==',key_name='tempest-keypair-1894281607',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:31:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e42e645406e44a9286cfb543f9d30064',ramdisk_id='',reservation_id='r-pxwx7fmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1222409128',owner_user_name='tempest-ServerActionsTestOtherB-1222409128-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:31:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='88947c21cb5b4c41969a408f949666c4',uuid=a8f1af9c-f6d1-4840-bf52-ba2526c558b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converting VIF {"id": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "address": "fa:16:3e:92:6c:c0", "network": {"id": "2c22e48c-2602-4bf9-ab60-6f799612a39a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-675599451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e42e645406e44a9286cfb543f9d30064", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73961bb4-e1", "ovs_interfaceid": "73961bb4-e1a8-481e-9883-9dbe008a55d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_vif [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73961bb4-e1, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:34:31 user nova-compute[73121]: INFO os_vif [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:6c:c0,bridge_name='br-int',has_traffic_filtering=True,id=73961bb4-e1a8-481e-9883-9dbe008a55d9,network=Network(2c22e48c-2602-4bf9-ab60-6f799612a39a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73961bb4-e1')
Aug 15 02:34:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjAuvDRS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:34:31 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cadb5a-7a5e-46eb-b550-84f5c16b7ab1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa647d7-0153-410b-bc84-c39456b281f8]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:34:31 user nova-compute[73121]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:34:31 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:34:31 user nova-compute[73121]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d (non-flash)
Aug 15 02:34:31 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc44cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d'): ({'sdc'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Removing single pathed devices sdc {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[706ed835-6c8f-47bd-8df8-1e8f5cdcb9a1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcc075b-239e-472c-a516-0d962bdd7f4b]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Flushing IO for device /dev/sdc {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5844e250-c29c-48ae-a823-f1c855b11aaa]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab5a519-54d7-4b58-b90d-66929f8193a0]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] SCSI volumes sdc have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[465461a4-d067-406a-a159-5caffa498dd2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[137e9a06-9006-44f5-a4f4-edb84119c5e3]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260]
Aug 15 02:34:31 user nova-compute[73121]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d, portal: 172.16.0.220,3260] successful.
Aug 15 02:34:31 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b86422f-248b-4cf1-80dd-3e3c448c0c1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e7eea4-833a-4a8e-a231-5569e7546606]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] <== disconnect_volume: return (277ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:34:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Deleting instance files /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0_del
Aug 15 02:34:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Deletion of /opt/stack/data/nova/instances/a8f1af9c-f6d1-4840-bf52-ba2526c558b0_del complete
Aug 15 02:34:31 user nova-compute[73121]: INFO nova.compute.manager [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 15 02:34:31 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:34:31 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:34:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-8bb86f8b-733d-43f9-aab6-bdf7b5354fbc req-bea0aa62-3eea-4a0a-84e7-831229cd1df3 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:34:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8bb86f8b-733d-43f9-aab6-bdf7b5354fbc req-bea0aa62-3eea-4a0a-84e7-831229cd1df3 service nova] Acquiring lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8bb86f8b-733d-43f9-aab6-bdf7b5354fbc req-bea0aa62-3eea-4a0a-84e7-831229cd1df3 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8bb86f8b-733d-43f9-aab6-bdf7b5354fbc req-bea0aa62-3eea-4a0a-84e7-831229cd1df3 service nova] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-8bb86f8b-733d-43f9-aab6-bdf7b5354fbc req-bea0aa62-3eea-4a0a-84e7-831229cd1df3 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] No waiting events found dispatching network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:34:32 user nova-compute[73121]: WARNING nova.compute.manager [req-8bb86f8b-733d-43f9-aab6-bdf7b5354fbc req-bea0aa62-3eea-4a0a-84e7-831229cd1df3 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received unexpected event network-vif-plugged-73961bb4-e1a8-481e-9883-9dbe008a55d9 for instance with vm_state active and task_state deleting.
Aug 15 02:34:32 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:34:32 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Took 1.31 seconds to deallocate network for instance.
Aug 15 02:34:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-0337ae96-53c2-4e2b-ba3c-52dc19b3007b req-b4225503-f3e4-47c8-80a4-db19a0a5d229 service nova] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Received event network-vif-deleted-73961bb4-e1a8-481e-9883-9dbe008a55d9 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:34:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:33 user nova-compute[73121]: INFO nova.compute.manager [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Took 0.85 seconds to detach 1 volumes for instance.
Aug 15 02:34:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:33 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:34:33 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:34:33 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:34 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Deleted allocations for instance a8f1af9c-f6d1-4840-bf52-ba2526c558b0
Aug 15 02:34:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b5d1be1f-9c64-4e3b-adf8-ac3cf6a19865 tempest-ServerActionsTestOtherB-1222409128 tempest-ServerActionsTestOtherB-1222409128-project-member] Lock "a8f1af9c-f6d1-4840-bf52-ba2526c558b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.690s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:34:39 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:34:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:34:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:34:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:34:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:34:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:34:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating instance_info_cache with network_info: [{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:45 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73121) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066871.178032, a8f1af9c-f6d1-4840-bf52-ba2526c558b0 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:34:46 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] VM Stopped (Lifecycle Event)
Aug 15 02:34:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-a953e978-df02-414c-8184-6f91c31ee144 None None] [instance: a8f1af9c-f6d1-4840-bf52-ba2526c558b0] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:46 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:34:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:34:48 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:34:48 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8331MB free_disk=25.204021453857422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 45755efe-f0af-43db-adf6-1b11505e942e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d25460df-911c-4b29-892e-89747d40d6b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:34:48 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:34:50 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:34:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:34:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:34:59 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:35:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:35:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:35:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:35:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:29 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-0ccef111-b19a-4a23-a7a3-cbccb69d78bb req-3226aa9d-e9b4-4e52-b9ed-540c0a5ad222 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-changed-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-0ccef111-b19a-4a23-a7a3-cbccb69d78bb req-3226aa9d-e9b4-4e52-b9ed-540c0a5ad222 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Refreshing instance network info cache due to event network-changed-763418ec-aa43-4cb0-8a6c-8d90a11de5db. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0ccef111-b19a-4a23-a7a3-cbccb69d78bb req-3226aa9d-e9b4-4e52-b9ed-540c0a5ad222 service nova] Acquiring lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0ccef111-b19a-4a23-a7a3-cbccb69d78bb req-3226aa9d-e9b4-4e52-b9ed-540c0a5ad222 service nova] Acquired lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.network.neutron [req-0ccef111-b19a-4a23-a7a3-cbccb69d78bb req-3226aa9d-e9b4-4e52-b9ed-540c0a5ad222 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Refreshing network info cache for port 763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:35:32 user nova-compute[73121]: INFO nova.compute.manager [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Detaching volume 60be6845-82bd-4530-9877-ea2bfe681de7
Aug 15 02:35:32 user nova-compute[73121]: INFO nova.virt.block_device [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Attempting to driver detach volume 60be6845-82bd-4530-9877-ea2bfe681de7 from mountpoint /dev/vdb
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Attempting to detach device vdb from instance 45755efe-f0af-43db-adf6-1b11505e942e from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:35:32 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:35:32 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:35:32 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:35:32 user nova-compute[73121]:   <serial>60be6845-82bd-4530-9877-ea2bfe681de7</serial>
Aug 15 02:35:32 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:35:32 user nova-compute[73121]: </disk>
Aug 15 02:35:32 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:35:32 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Successfully detached device vdb from instance 45755efe-f0af-43db-adf6-1b11505e942e from the persistent domain config.
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45755efe-f0af-43db-adf6-1b11505e942e from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:35:32 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:35:32 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:35:32 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:35:32 user nova-compute[73121]:   <serial>60be6845-82bd-4530-9877-ea2bfe681de7</serial>
Aug 15 02:35:32 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:35:32 user nova-compute[73121]: </disk>
Aug 15 02:35:32 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.network.neutron [req-0ccef111-b19a-4a23-a7a3-cbccb69d78bb req-3226aa9d-e9b4-4e52-b9ed-540c0a5ad222 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updated VIF entry in instance network info cache for port 763418ec-aa43-4cb0-8a6c-8d90a11de5db. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.network.neutron [req-0ccef111-b19a-4a23-a7a3-cbccb69d78bb req-3226aa9d-e9b4-4e52-b9ed-540c0a5ad222 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating instance_info_cache with network_info: [{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-0ccef111-b19a-4a23-a7a3-cbccb69d78bb req-3226aa9d-e9b4-4e52-b9ed-540c0a5ad222 service nova] Releasing lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692066932.9485433, 45755efe-f0af-43db-adf6-1b11505e942e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:35:32 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Successfully detached device vdb from instance 45755efe-f0af-43db-adf6-1b11505e942e from the live domain config.
Aug 15 02:35:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HPvfNopx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:35:32 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:35:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a99be5d-4c03-44c0-9d83-c9bde4526b18]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:32 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc4cb1-5cfc-42f8-949e-88622409fb5c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:35:33 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 (non-flash)
Aug 15 02:35:33 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e20409240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6bb37f-a28b-4dfc-951c-6ae1237537cb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3497a3ca-85c5-405a-8370-a61e477b6bbd]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc46a65-b8e3-4a95-bbc6-2bc6702daac7]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f4d34-1649-4314-b3fd-53a77335a922]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca601664-7c83-4014-a13a-5abca63263dc]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe63a5-fd63-44bf-9b1a-e39f1b24428a]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7, portal: 172.16.0.220,3260]
Aug 15 02:35:33 user nova-compute[73121]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7, portal: 172.16.0.220,3260] successful.
Aug 15 02:35:33 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60be6845-82bd-4530-9877-ea2bfe681de7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb39e92-06fd-4f37-92c1-d98ce95e0c56]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] <== disconnect_volume: return (267ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:35:33 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'flavor' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:35:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ad2c7c0b-8af1-4838-a82b-7dad45c0cdd1 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:35:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-fdafbe1d-634f-4891-8c71-d44374ab816b req-ef69c090-8637-45cc-bbc2-1728f7749256 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-changed-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:35:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-fdafbe1d-634f-4891-8c71-d44374ab816b req-ef69c090-8637-45cc-bbc2-1728f7749256 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Refreshing instance network info cache due to event network-changed-763418ec-aa43-4cb0-8a6c-8d90a11de5db. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:35:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fdafbe1d-634f-4891-8c71-d44374ab816b req-ef69c090-8637-45cc-bbc2-1728f7749256 service nova] Acquiring lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:35:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fdafbe1d-634f-4891-8c71-d44374ab816b req-ef69c090-8637-45cc-bbc2-1728f7749256 service nova] Acquired lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:35:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-fdafbe1d-634f-4891-8c71-d44374ab816b req-ef69c090-8637-45cc-bbc2-1728f7749256 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Refreshing network info cache for port 763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:35:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-fdafbe1d-634f-4891-8c71-d44374ab816b req-ef69c090-8637-45cc-bbc2-1728f7749256 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updated VIF entry in instance network info cache for port 763418ec-aa43-4cb0-8a6c-8d90a11de5db. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:35:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-fdafbe1d-634f-4891-8c71-d44374ab816b req-ef69c090-8637-45cc-bbc2-1728f7749256 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating instance_info_cache with network_info: [{"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:35:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fdafbe1d-634f-4891-8c71-d44374ab816b req-ef69c090-8637-45cc-bbc2-1728f7749256 service nova] Releasing lock "refresh_cache-45755efe-f0af-43db-adf6-1b11505e942e" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:35:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:38 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:40 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:40 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:35:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:35:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updating instance_info_cache with network_info: [{"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-6ecfcc84-d915-4eac-bbf6-9ab2b5782088" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:35:47 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:48 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:50 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:35:50 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8414MB free_disk=25.194217681884766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 45755efe-f0af-43db-adf6-1b11505e942e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d25460df-911c-4b29-892e-89747d40d6b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:35:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:35:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-fd457be4-8a83-41db-b433-801f43542524 req-f8948389-7761-403c-a610-fde9678fafa4 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received event network-changed-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:35:51 user nova-compute[73121]: DEBUG nova.compute.manager [req-fd457be4-8a83-41db-b433-801f43542524 req-f8948389-7761-403c-a610-fde9678fafa4 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Refreshing instance network info cache due to event network-changed-59d20bfa-413d-4c52-a403-4a682b673db6. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:35:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fd457be4-8a83-41db-b433-801f43542524 req-f8948389-7761-403c-a610-fde9678fafa4 service nova] Acquiring lock "refresh_cache-d25460df-911c-4b29-892e-89747d40d6b2" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:35:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fd457be4-8a83-41db-b433-801f43542524 req-f8948389-7761-403c-a610-fde9678fafa4 service nova] Acquired lock "refresh_cache-d25460df-911c-4b29-892e-89747d40d6b2" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:35:51 user nova-compute[73121]: DEBUG nova.network.neutron [req-fd457be4-8a83-41db-b433-801f43542524 req-f8948389-7761-403c-a610-fde9678fafa4 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Refreshing network info cache for port 59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:35:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-fd457be4-8a83-41db-b433-801f43542524 req-f8948389-7761-403c-a610-fde9678fafa4 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Updated VIF entry in instance network info cache for port 59d20bfa-413d-4c52-a403-4a682b673db6. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:35:52 user nova-compute[73121]: DEBUG nova.network.neutron [req-fd457be4-8a83-41db-b433-801f43542524 req-f8948389-7761-403c-a610-fde9678fafa4 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Updating instance_info_cache with network_info: [{"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:35:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fd457be4-8a83-41db-b433-801f43542524 req-f8948389-7761-403c-a610-fde9678fafa4 service nova] Releasing lock "refresh_cache-d25460df-911c-4b29-892e-89747d40d6b2" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:35:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:35:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:54 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lazy-loading 'flavor' on Instance uuid d25460df-911c-4b29-892e-89747d40d6b2 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:35:56 user nova-compute[73121]: INFO nova.compute.manager [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Attaching volume 6db454d2-a521-4285-a95d-7f909236432c to /dev/vdb
Aug 15 02:35:56 user nova-compute[73121]: DEBUG os_brick.utils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08720a-a485-4820-85c7-06c7809acb10]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6990c474-5707-4dfb-a120-b425ebe32c60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ef263d-6161-497e-9539-f1663ca1cf97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[db18c1ff-8e93-4c47-9236-d8d1c8f27ed2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:35:56 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:35:56 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9b6a93-a0be-4409-8060-7aff9351a71f]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG os_brick.utils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:35:56 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Updating existing volume attachment record: 0cae516f-6acd-4ce8-90b8-1399991c05fc {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:35:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:35:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquiring lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:36:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:02 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:36:02 user nova-compute[73121]: INFO nova.compute.claims [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Claim successful on node user
Aug 15 02:36:02 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:36:02 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG nova.network.neutron [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:36:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:36:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG nova.policy [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ff1d8a1832b41f19f75a0aec9629f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0219a655be74e95b1027021e2670bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:36:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Creating image(s)
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "/opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "/opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.173s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk 1073741824" returned: 0 in 0.049s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG nova.network.neutron [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Successfully created port: 4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:36:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Cannot resize image /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG nova.objects.instance [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lazy-loading 'migration_context' on Instance uuid e7abf1e7-bf7b-42b7-b4db-6065cf312f6c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Ensure instance console log exists: /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG nova.network.neutron [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Successfully updated port: 4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquiring lock "refresh_cache-e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquired lock "refresh_cache-e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG nova.network.neutron [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-2a0696db-51e8-460f-9447-db690815f10e req-7bf336b9-87cd-46f0-9cba-f139a6222a3b service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received event network-changed-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-2a0696db-51e8-460f-9447-db690815f10e req-7bf336b9-87cd-46f0-9cba-f139a6222a3b service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Refreshing instance network info cache due to event network-changed-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2a0696db-51e8-460f-9447-db690815f10e req-7bf336b9-87cd-46f0-9cba-f139a6222a3b service nova] Acquiring lock "refresh_cache-e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:36:04 user nova-compute[73121]: DEBUG nova.network.neutron [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVDqxzIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:36:05 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:36:05 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:36:05 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.network.neutron [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Updating instance_info_cache with network_info: [{"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcf7444-f408-4a18-8093-67ae5442d274]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:36:05 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Releasing lock "refresh_cache-e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Instance network_info: |[{"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2a0696db-51e8-460f-9447-db690815f10e req-7bf336b9-87cd-46f0-9cba-f139a6222a3b service nova] Acquired lock "refresh_cache-e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.network.neutron [req-2a0696db-51e8-460f-9447-db690815f10e req-7bf336b9-87cd-46f0-9cba-f139a6222a3b service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Refreshing network info cache for port 4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Start _get_guest_xml network_info=[{"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1875ad5-ac99-45ef-941f-46e75e5b22f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c] added
Aug 15 02:36:05 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:36:05 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-502671766',display_name='tempest-VolumesActionsTest-instance-502671766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-502671766',id=50,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0219a655be74e95b1027021e2670bcd',ramdisk_id='',reservation_id='r-irpw66jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-760364533',owner_user_name='tempest-VolumesActionsTest-760364533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:36:03Z,user_data=None,user_id='0ff1d8a1832b41f19f75a0aec9629f65',uuid=e7abf1e7-bf7b-42b7-b4db-6065cf312f6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Converting VIF {"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:87:c3,bridge_name='br-int',has_traffic_filtering=True,id=4f8b1dcb-bfd3-4b6d-8f3f-085186a79179,network=Network(ea020078-ba99-410b-8c27-1210f719c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8b1dcb-bf') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.objects.instance [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lazy-loading 'pci_devices' on Instance uuid e7abf1e7-bf7b-42b7-b4db-6065cf312f6c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbfd357-4850-4894-a009-df31323ea858]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:36:05 user nova-compute[73121]:   <uuid>e7abf1e7-bf7b-42b7-b4db-6065cf312f6c</uuid>
Aug 15 02:36:05 user nova-compute[73121]:   <name>instance-00000032</name>
Aug 15 02:36:05 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:36:05 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:36:05 user nova-compute[73121]:   <metadata>
Aug 15 02:36:05 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:36:05 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:36:05 user nova-compute[73121]:       <nova:name>tempest-VolumesActionsTest-instance-502671766</nova:name>
Aug 15 02:36:05 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:36:05</nova:creationTime>
Aug 15 02:36:05 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:36:05 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:36:05 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:36:05 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:36:05 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:36:05 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:36:05 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:36:05 user nova-compute[73121]:       <nova:owner>
Aug 15 02:36:05 user nova-compute[73121]:         <nova:user uuid="0ff1d8a1832b41f19f75a0aec9629f65">tempest-VolumesActionsTest-760364533-project-member</nova:user>
Aug 15 02:36:05 user nova-compute[73121]:         <nova:project uuid="f0219a655be74e95b1027021e2670bcd">tempest-VolumesActionsTest-760364533</nova:project>
Aug 15 02:36:05 user nova-compute[73121]:       </nova:owner>
Aug 15 02:36:05 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:36:05 user nova-compute[73121]:       <nova:ports>
Aug 15 02:36:05 user nova-compute[73121]:         <nova:port uuid="4f8b1dcb-bfd3-4b6d-8f3f-085186a79179">
Aug 15 02:36:05 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 02:36:05 user nova-compute[73121]:         </nova:port>
Aug 15 02:36:05 user nova-compute[73121]:       </nova:ports>
Aug 15 02:36:05 user nova-compute[73121]:     </nova:instance>
Aug 15 02:36:05 user nova-compute[73121]:   </metadata>
Aug 15 02:36:05 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:36:05 user nova-compute[73121]:     <system>
Aug 15 02:36:05 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:36:05 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:36:05 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:36:05 user nova-compute[73121]:       <entry name="serial">e7abf1e7-bf7b-42b7-b4db-6065cf312f6c</entry>
Aug 15 02:36:05 user nova-compute[73121]:       <entry name="uuid">e7abf1e7-bf7b-42b7-b4db-6065cf312f6c</entry>
Aug 15 02:36:05 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:36:05 user nova-compute[73121]:     </system>
Aug 15 02:36:05 user nova-compute[73121]:   </sysinfo>
Aug 15 02:36:05 user nova-compute[73121]:   <os>
Aug 15 02:36:05 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:36:05 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:36:05 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:36:05 user nova-compute[73121]:   </os>
Aug 15 02:36:05 user nova-compute[73121]:   <features>
Aug 15 02:36:05 user nova-compute[73121]:     <acpi/>
Aug 15 02:36:05 user nova-compute[73121]:     <apic/>
Aug 15 02:36:05 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:36:05 user nova-compute[73121]:   </features>
Aug 15 02:36:05 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:36:05 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:36:05 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:36:05 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:36:05 user nova-compute[73121]:   </clock>
Aug 15 02:36:05 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:36:05 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:36:05 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:36:05 user nova-compute[73121]:   </cpu>
Aug 15 02:36:05 user nova-compute[73121]:   <devices>
Aug 15 02:36:05 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:36:05 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:36:05 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk"/>
Aug 15 02:36:05 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:36:05 user nova-compute[73121]:     </disk>
Aug 15 02:36:05 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:36:05 user nova-compute[73121]:       <mac address="fa:16:3e:96:87:c3"/>
Aug 15 02:36:05 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:36:05 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:36:05 user nova-compute[73121]:       <target dev="tap4f8b1dcb-bf"/>
Aug 15 02:36:05 user nova-compute[73121]:     </interface>
Aug 15 02:36:05 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:36:05 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/console.log" append="off"/>
Aug 15 02:36:05 user nova-compute[73121]:     </serial>
Aug 15 02:36:05 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:36:05 user nova-compute[73121]:     <video>
Aug 15 02:36:05 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:36:05 user nova-compute[73121]:     </video>
Aug 15 02:36:05 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:36:05 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:36:05 user nova-compute[73121]:     </rng>
Aug 15 02:36:05 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:36:05 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:36:05 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:36:05 user nova-compute[73121]:     </memballoon>
Aug 15 02:36:05 user nova-compute[73121]:   </devices>
Aug 15 02:36:05 user nova-compute[73121]: </domain>
Aug 15 02:36:05 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-502671766',display_name='tempest-VolumesActionsTest-instance-502671766',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-502671766',id=50,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0219a655be74e95b1027021e2670bcd',ramdisk_id='',reservation_id='r-irpw66jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-760364533',owner_user_name='tempest-VolumesActionsTest-760364533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:36:03Z,user_data=None,user_id='0ff1d8a1832b41f19f75a0aec9629f65',uuid=e7abf1e7-bf7b-42b7-b4db-6065cf312f6c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Converting VIF {"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:87:c3,bridge_name='br-int',has_traffic_filtering=True,id=4f8b1dcb-bfd3-4b6d-8f3f-085186a79179,network=Network(ea020078-ba99-410b-8c27-1210f719c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8b1dcb-bf') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_vif [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:87:c3,bridge_name='br-int',has_traffic_filtering=True,id=4f8b1dcb-bfd3-4b6d-8f3f-085186a79179,network=Network(ea020078-ba99-410b-8c27-1210f719c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8b1dcb-bf') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f8b1dcb-bf, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4f8b1dcb-bf, col_values=(('external_ids', {'iface-id': '4f8b1dcb-bfd3-4b6d-8f3f-085186a79179', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:87:c3', 'vm-uuid': 'e7abf1e7-bf7b-42b7-b4db-6065cf312f6c'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d199ff-22e3-4912-9368-e82770eeac60]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVDqxzIf {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:05 user nova-compute[73121]: INFO os_vif [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:87:c3,bridge_name='br-int',has_traffic_filtering=True,id=4f8b1dcb-bfd3-4b6d-8f3f-085186a79179,network=Network(ea020078-ba99-410b-8c27-1210f719c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8b1dcb-bf')
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YVDqxzIf" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bbe055-c633-472c-8be5-1d04a6cc2507]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YVDqxzIf'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[58117eb2-83b0-4384-a0d0-e4ff46e4a7bf]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] No VIF found with MAC fa:16:3e:96:87:c3, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5627d3-09fa-4853-90b3-4374b95eb7ed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:36:05 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:36:05 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:36:05 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:36:05 user nova-compute[73121]: 
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e92e98-9a21-4ed4-9b84-6bc83d327439]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c, portal: 172.16.0.220,3260]
Aug 15 02:36:05 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c, portal: 172.16.0.220,3260] successful.
Aug 15 02:36:05 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ebf2a0-cda1-4865-82cb-0b8836cee3d4]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ec64a-4f0d-42e9-bfc2-f72115b66d9b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c (non-flash)
Aug 15 02:36:05 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c (non-flash)
Aug 15 02:36:05 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45cf263-549b-4765-ae6f-c7d99684a3c1]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.network.neutron [req-2a0696db-51e8-460f-9447-db690815f10e req-7bf336b9-87cd-46f0-9cba-f139a6222a3b service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Updated VIF entry in instance network info cache for port 4f8b1dcb-bfd3-4b6d-8f3f-085186a79179. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG nova.network.neutron [req-2a0696db-51e8-460f-9447-db690815f10e req-7bf336b9-87cd-46f0-9cba-f139a6222a3b service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Updating instance_info_cache with network_info: [{"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:36:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-2a0696db-51e8-460f-9447-db690815f10e req-7bf336b9-87cd-46f0-9cba-f139a6222a3b service nova] Releasing lock "refresh_cache-e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVDqxzIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26166363566666162', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166363566666162', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lazy-loading 'flavor' on Instance uuid d25460df-911c-4b29-892e-89747d40d6b2 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:36:06 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:36:06 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:36:06 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:36:06 user nova-compute[73121]:   <serial>6db454d2-a521-4285-a95d-7f909236432c</serial>
Aug 15 02:36:06 user nova-compute[73121]: </disk>
Aug 15 02:36:06 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-f297a4fa-51ad-4dbd-bdb7-d7560fae4cec req-7eac6b9b-f96d-44d2-b046-567cc7e1c966 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received event network-vif-plugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f297a4fa-51ad-4dbd-bdb7-d7560fae4cec req-7eac6b9b-f96d-44d2-b046-567cc7e1c966 service nova] Acquiring lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f297a4fa-51ad-4dbd-bdb7-d7560fae4cec req-7eac6b9b-f96d-44d2-b046-567cc7e1c966 service nova] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-f297a4fa-51ad-4dbd-bdb7-d7560fae4cec req-7eac6b9b-f96d-44d2-b046-567cc7e1c966 service nova] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:06 user nova-compute[73121]: DEBUG nova.compute.manager [req-f297a4fa-51ad-4dbd-bdb7-d7560fae4cec req-7eac6b9b-f96d-44d2-b046-567cc7e1c966 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] No waiting events found dispatching network-vif-plugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:36:06 user nova-compute[73121]: WARNING nova.compute.manager [req-f297a4fa-51ad-4dbd-bdb7-d7560fae4cec req-7eac6b9b-f96d-44d2-b046-567cc7e1c966 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received unexpected event network-vif-plugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 for instance with vm_state building and task_state spawning.
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Verify base images {{(pid=73121) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Image id a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb yields fingerprint 59ad79752be594ac21578a5f016dcc5267c7944a {{(pid=73121) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 02:36:07 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] image a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb at (/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a): checking
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] image a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb at (/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a): image is in use {{(pid=73121) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73121) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 is a valid instance name {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 has a disk file {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 is backed by 59ad79752be594ac21578a5f016dcc5267c7944a {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] e7abf1e7-bf7b-42b7-b4db-6065cf312f6c is a valid instance name {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] e7abf1e7-bf7b-42b7-b4db-6065cf312f6c has a disk file {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] No VIF found with MAC fa:16:3e:97:69:25, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance e7abf1e7-bf7b-42b7-b4db-6065cf312f6c is backed by 59ad79752be594ac21578a5f016dcc5267c7944a {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] 22339f3c-9ef1-4630-94c2-a56f0b97aba6 is a valid instance name {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] 22339f3c-9ef1-4630-94c2-a56f0b97aba6 has a disk file {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7b668465-1fce-4ad4-b90d-48bb74c98787 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.363s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 is backed by 59ad79752be594ac21578a5f016dcc5267c7944a {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] d25460df-911c-4b29-892e-89747d40d6b2 is a valid instance name {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] d25460df-911c-4b29-892e-89747d40d6b2 has a disk file {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d25460df-911c-4b29-892e-89747d40d6b2 is backed by 59ad79752be594ac21578a5f016dcc5267c7944a {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] 45755efe-f0af-43db-adf6-1b11505e942e is a valid instance name {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] 45755efe-f0af-43db-adf6-1b11505e942e has a disk file {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 02:36:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:08 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 45755efe-f0af-43db-adf6-1b11505e942e is backed by 59ad79752be594ac21578a5f016dcc5267c7944a {{(pid=73121) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 02:36:08 user nova-compute[73121]: WARNING nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06
Aug 15 02:36:08 user nova-compute[73121]: WARNING nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb
Aug 15 02:36:08 user nova-compute[73121]: WARNING nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0
Aug 15 02:36:08 user nova-compute[73121]: WARNING nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632
Aug 15 02:36:08 user nova-compute[73121]: WARNING nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4
Aug 15 02:36:08 user nova-compute[73121]: WARNING nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa
Aug 15 02:36:08 user nova-compute[73121]: WARNING nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2
Aug 15 02:36:08 user nova-compute[73121]: WARNING nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Unknown base file: /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Active base files: /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Removable base files: /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06 /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0 /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632 /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4 /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2 /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9db766a6e9ab5731fa1616733e18854ba99e1f06
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/765991b5997a1b74921ce2e49a3c593bda84e0cb
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8c74a1dcce6763897340bedd478a28e98d0e65c0
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3d6841e99a0bd61a1eb48b98a5f2c916d47c3632
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/436def45bbecee2c9b221de4179377ebda4fa1b4
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7a9a26e591f195431b5efc9512b292ac7f3b16aa
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/38b97932018985ca76932c32ce5019b9575169c2
Aug 15 02:36:08 user nova-compute[73121]: INFO nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/52e48a2b34ef85767038d637d0ac996a8663421e
Aug 15 02:36:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Verification complete {{(pid=73121) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 15 02:36:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Verify swap images {{(pid=73121) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 15 02:36:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.imagecache [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Verify ephemeral images {{(pid=73121) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 15 02:36:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-1525d163-7003-4bb2-8e1e-fab7ea26d23a req-17f7e401-69bd-48ba-8409-7ee71132c9e4 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received event network-vif-plugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1525d163-7003-4bb2-8e1e-fab7ea26d23a req-17f7e401-69bd-48ba-8409-7ee71132c9e4 service nova] Acquiring lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1525d163-7003-4bb2-8e1e-fab7ea26d23a req-17f7e401-69bd-48ba-8409-7ee71132c9e4 service nova] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1525d163-7003-4bb2-8e1e-fab7ea26d23a req-17f7e401-69bd-48ba-8409-7ee71132c9e4 service nova] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-1525d163-7003-4bb2-8e1e-fab7ea26d23a req-17f7e401-69bd-48ba-8409-7ee71132c9e4 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] No waiting events found dispatching network-vif-plugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:36:09 user nova-compute[73121]: WARNING nova.compute.manager [req-1525d163-7003-4bb2-8e1e-fab7ea26d23a req-17f7e401-69bd-48ba-8409-7ee71132c9e4 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received unexpected event network-vif-plugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 for instance with vm_state building and task_state spawning.
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066969.2065785, e7abf1e7-bf7b-42b7-b4db-6065cf312f6c => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] VM Resumed (Lifecycle Event)
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Instance spawned successfully.
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692066969.2137558, e7abf1e7-bf7b-42b7-b4db-6065cf312f6c => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] VM Started (Lifecycle Event)
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Took 6.12 seconds to spawn the instance on the hypervisor.
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.compute.manager [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Detaching volume 6db454d2-a521-4285-a95d-7f909236432c
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.compute.manager [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Took 6.72 seconds to build instance.
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-88777717-a6d3-4872-9578-26ddc9432652 tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.816s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.virt.block_device [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Attempting to driver detach volume 6db454d2-a521-4285-a95d-7f909236432c from mountpoint /dev/vdb
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Attempting to detach device vdb from instance d25460df-911c-4b29-892e-89747d40d6b2 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:36:09 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:36:09 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:36:09 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:36:09 user nova-compute[73121]:   <serial>6db454d2-a521-4285-a95d-7f909236432c</serial>
Aug 15 02:36:09 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:36:09 user nova-compute[73121]: </disk>
Aug 15 02:36:09 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Successfully detached device vdb from instance d25460df-911c-4b29-892e-89747d40d6b2 from the persistent domain config.
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d25460df-911c-4b29-892e-89747d40d6b2 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:36:09 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:36:09 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:36:09 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:36:09 user nova-compute[73121]:   <serial>6db454d2-a521-4285-a95d-7f909236432c</serial>
Aug 15 02:36:09 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:36:09 user nova-compute[73121]: </disk>
Aug 15 02:36:09 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692066969.935274, d25460df-911c-4b29-892e-89747d40d6b2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d25460df-911c-4b29-892e-89747d40d6b2 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:36:09 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Successfully detached device vdb from instance d25460df-911c-4b29-892e-89747d40d6b2 from the live domain config.
Aug 15 02:36:09 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YVDqxzIf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:36:09 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:36:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8855b1-fd07-414c-bdd4-24781ac0ad9c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f5fcf1-0f07-4f2b-b13b-f888832df06e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c (non-flash)
Aug 15 02:36:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c (non-flash)
Aug 15 02:36:09 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc60c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:36:09 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b32719e-7ad9-44bb-b5a4-92e810866346]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b3d76f-2c24-44a1-a7ec-b11eff5f1bb2]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc7435-19ed-431f-92e9-35f97e842207]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[562305bd-15e5-4d1c-bea3-266d4b607905]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d0f22f-3a6e-48ac-badf-da225b50a212]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa76e93-25bf-4c5d-91b5-a76deb21ff19]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c, portal: 172.16.0.220,3260]
Aug 15 02:36:10 user nova-compute[73121]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c, portal: 172.16.0.220,3260] successful.
Aug 15 02:36:10 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6db454d2-a521-4285-a95d-7f909236432c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795b115-132c-4b1a-8042-b009d740aae9]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] <== disconnect_volume: return (280ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:36:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lazy-loading 'flavor' on Instance uuid d25460df-911c-4b29-892e-89747d40d6b2 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:36:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-5ae7b2bc-2a5e-4420-b1fc-7de684c3cdf4 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.680s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:22 user nova-compute[73121]: INFO nova.compute.manager [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Terminating instance
Aug 15 02:36:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:36:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-80f03c6f-354e-4399-914c-fb246b45a605 req-8515b2b3-8fea-4e42-b19a-2d8f161f4260 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-80f03c6f-354e-4399-914c-fb246b45a605 req-8515b2b3-8fea-4e42-b19a-2d8f161f4260 service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-80f03c6f-354e-4399-914c-fb246b45a605 req-8515b2b3-8fea-4e42-b19a-2d8f161f4260 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-80f03c6f-354e-4399-914c-fb246b45a605 req-8515b2b3-8fea-4e42-b19a-2d8f161f4260 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-80f03c6f-354e-4399-914c-fb246b45a605 req-8515b2b3-8fea-4e42-b19a-2d8f161f4260 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-80f03c6f-354e-4399-914c-fb246b45a605 req-8515b2b3-8fea-4e42-b19a-2d8f161f4260 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-unplugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Instance destroyed successfully.
Aug 15 02:36:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'resources' on Instance uuid 45755efe-f0af-43db-adf6-1b11505e942e {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:29:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1334642393',display_name='tempest-ServerRescueNegativeTestJSON-server-1334642393',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1334642393',id=48,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrBKQDhf63xKfzygFzHqTcClP3fPLPjZleMtvoqYdSNuDGoHYvBiWiUH3BSiIlLTZfeH0OF0Ry7ReviEO+9ZHPmxLI4h4oAbL/G1fFiKntcUXiEZef88ZJW7BUnjHmawQ==',key_name='tempest-keypair-1977733763',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:31:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-aezvhlip',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=45755efe-f0af-43db-adf6-1b11505e942e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "address": "fa:16:3e:d8:fb:7f", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap763418ec-aa", "ovs_interfaceid": "763418ec-aa43-4cb0-8a6c-8d90a11de5db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=763418ec-aa43-4cb0-8a6c-8d90a11de5db,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763418ec-aa') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG os_vif [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=763418ec-aa43-4cb0-8a6c-8d90a11de5db,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763418ec-aa') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap763418ec-aa, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:23 user nova-compute[73121]: INFO os_vif [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:fb:7f,bridge_name='br-int',has_traffic_filtering=True,id=763418ec-aa43-4cb0-8a6c-8d90a11de5db,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap763418ec-aa')
Aug 15 02:36:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Deleting instance files /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e_del
Aug 15 02:36:23 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Deletion of /opt/stack/data/nova/instances/45755efe-f0af-43db-adf6-1b11505e942e_del complete
Aug 15 02:36:23 user nova-compute[73121]: INFO nova.compute.manager [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 02:36:23 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:36:23 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:36:24 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:36:24 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Took 0.82 seconds to deallocate network for instance.
Aug 15 02:36:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:24 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:36:24 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:36:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:24 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Deleted allocations for instance 45755efe-f0af-43db-adf6-1b11505e942e
Aug 15 02:36:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fcd-19d7-4615-a39c-a570fa4db3af tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "45755efe-f0af-43db-adf6-1b11505e942e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-8c12e6c3-5a69-4c4f-9ca2-6f02ec0ccae9 req-4a2354aa-e754-4a0c-84b3-60af46c88239 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:36:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8c12e6c3-5a69-4c4f-9ca2-6f02ec0ccae9 req-4a2354aa-e754-4a0c-84b3-60af46c88239 service nova] Acquiring lock "45755efe-f0af-43db-adf6-1b11505e942e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8c12e6c3-5a69-4c4f-9ca2-6f02ec0ccae9 req-4a2354aa-e754-4a0c-84b3-60af46c88239 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-8c12e6c3-5a69-4c4f-9ca2-6f02ec0ccae9 req-4a2354aa-e754-4a0c-84b3-60af46c88239 service nova] Lock "45755efe-f0af-43db-adf6-1b11505e942e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-8c12e6c3-5a69-4c4f-9ca2-6f02ec0ccae9 req-4a2354aa-e754-4a0c-84b3-60af46c88239 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] No waiting events found dispatching network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:36:25 user nova-compute[73121]: WARNING nova.compute.manager [req-8c12e6c3-5a69-4c4f-9ca2-6f02ec0ccae9 req-4a2354aa-e754-4a0c-84b3-60af46c88239 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received unexpected event network-vif-plugged-763418ec-aa43-4cb0-8a6c-8d90a11de5db for instance with vm_state deleted and task_state None.
Aug 15 02:36:25 user nova-compute[73121]: DEBUG nova.compute.manager [req-8c12e6c3-5a69-4c4f-9ca2-6f02ec0ccae9 req-4a2354aa-e754-4a0c-84b3-60af46c88239 service nova] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Received event network-vif-deleted-763418ec-aa43-4cb0-8a6c-8d90a11de5db {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:36:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:38 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692066983.5156107, 45755efe-f0af-43db-adf6-1b11505e942e => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:36:38 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] VM Stopped (Lifecycle Event)
Aug 15 02:36:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-3bad4d80-b6d3-49b1-81c4-060d42be947b None None] [instance: 45755efe-f0af-43db-adf6-1b11505e942e] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:36:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:36:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updating instance_info_cache with network_info: [{"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-22339f3c-9ef1-4630-94c2-a56f0b97aba6" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:36:49 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:36:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:36:52 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:36:52 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8415MB free_disk=25.191173553466797GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance d25460df-911c-4b29-892e-89747d40d6b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance e7abf1e7-bf7b-42b7-b4db-6065cf312f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:36:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:36:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:36:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:54 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:36:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:36:57 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:57 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:36:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:36:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:36:59 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:05 user nova-compute[73121]: INFO nova.compute.manager [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Terminating instance
Aug 15 02:37:05 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-1e19fe01-245d-4aa3-98b1-ab639ab5741a req-b8a5b41d-573f-45f1-b12a-0da8541f791c service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received event network-vif-unplugged-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1e19fe01-245d-4aa3-98b1-ab639ab5741a req-b8a5b41d-573f-45f1-b12a-0da8541f791c service nova] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1e19fe01-245d-4aa3-98b1-ab639ab5741a req-b8a5b41d-573f-45f1-b12a-0da8541f791c service nova] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1e19fe01-245d-4aa3-98b1-ab639ab5741a req-b8a5b41d-573f-45f1-b12a-0da8541f791c service nova] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-1e19fe01-245d-4aa3-98b1-ab639ab5741a req-b8a5b41d-573f-45f1-b12a-0da8541f791c service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] No waiting events found dispatching network-vif-unplugged-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-1e19fe01-245d-4aa3-98b1-ab639ab5741a req-b8a5b41d-573f-45f1-b12a-0da8541f791c service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received event network-vif-unplugged-59d20bfa-413d-4c52-a403-4a682b673db6 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:37:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Instance destroyed successfully.
Aug 15 02:37:06 user nova-compute[73121]: DEBUG nova.objects.instance [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lazy-loading 'resources' on Instance uuid d25460df-911c-4b29-892e-89747d40d6b2 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:33:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1237155660',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1237155660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1237155',id=49,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmZsUnebyrnZcIox54pEnx05v/SjPiW6ihKjawaFnwFCxrjGM+DkFXpZR4MWyjXlad9ITKnGOCo07X/dL5v5Q9z53huto47YLHRlO1FcYs1Ab2NuqdUIotWjq9oLkgPNQ==',key_name='tempest-keypair-706072691',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d4a5f286c3484342930ee93aff3215c1',ramdisk_id='',reservation_id='r-g0603sjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1001782466',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:34:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='653e644c87c64416b9ae9e8ac7fa00c3',uuid=d25460df-911c-4b29-892e-89747d40d6b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Converting VIF {"id": "59d20bfa-413d-4c52-a403-4a682b673db6", "address": "fa:16:3e:97:69:25", "network": {"id": "3ac3296c-7df6-442b-a9ae-e9edb8804412", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-149598094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d4a5f286c3484342930ee93aff3215c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59d20bfa-41", "ovs_interfaceid": "59d20bfa-413d-4c52-a403-4a682b673db6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:69:25,bridge_name='br-int',has_traffic_filtering=True,id=59d20bfa-413d-4c52-a403-4a682b673db6,network=Network(3ac3296c-7df6-442b-a9ae-e9edb8804412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d20bfa-41') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG os_vif [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:69:25,bridge_name='br-int',has_traffic_filtering=True,id=59d20bfa-413d-4c52-a403-4a682b673db6,network=Network(3ac3296c-7df6-442b-a9ae-e9edb8804412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d20bfa-41') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59d20bfa-41, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:06 user nova-compute[73121]: INFO os_vif [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:69:25,bridge_name='br-int',has_traffic_filtering=True,id=59d20bfa-413d-4c52-a403-4a682b673db6,network=Network(3ac3296c-7df6-442b-a9ae-e9edb8804412),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59d20bfa-41')
Aug 15 02:37:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Deleting instance files /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2_del
Aug 15 02:37:06 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Deletion of /opt/stack/data/nova/instances/d25460df-911c-4b29-892e-89747d40d6b2_del complete
Aug 15 02:37:06 user nova-compute[73121]: INFO nova.compute.manager [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Took 1.00 seconds to destroy the instance on the hypervisor.
Aug 15 02:37:06 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:37:06 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d25460df-911c-4b29-892e-89747d40d6b2] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:37:07 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Took 1.06 seconds to deallocate network for instance.
Aug 15 02:37:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-4f93eb4c-db5f-4f18-a39c-d96d70bbc4dd req-405d7f11-6617-472e-a778-a028fc21faca service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received event network-vif-deleted-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-1a519f30-3108-4f17-82f5-cc58c7cfdec8 req-c1153811-40f4-44dc-94cd-9e3f54174808 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received event network-vif-plugged-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1a519f30-3108-4f17-82f5-cc58c7cfdec8 req-c1153811-40f4-44dc-94cd-9e3f54174808 service nova] Acquiring lock "d25460df-911c-4b29-892e-89747d40d6b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1a519f30-3108-4f17-82f5-cc58c7cfdec8 req-c1153811-40f4-44dc-94cd-9e3f54174808 service nova] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1a519f30-3108-4f17-82f5-cc58c7cfdec8 req-c1153811-40f4-44dc-94cd-9e3f54174808 service nova] Lock "d25460df-911c-4b29-892e-89747d40d6b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:07 user nova-compute[73121]: DEBUG nova.compute.manager [req-1a519f30-3108-4f17-82f5-cc58c7cfdec8 req-c1153811-40f4-44dc-94cd-9e3f54174808 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] No waiting events found dispatching network-vif-plugged-59d20bfa-413d-4c52-a403-4a682b673db6 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:37:07 user nova-compute[73121]: WARNING nova.compute.manager [req-1a519f30-3108-4f17-82f5-cc58c7cfdec8 req-c1153811-40f4-44dc-94cd-9e3f54174808 service nova] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Received unexpected event network-vif-plugged-59d20bfa-413d-4c52-a403-4a682b673db6 for instance with vm_state deleted and task_state None.
Aug 15 02:37:07 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Deleted allocations for instance d25460df-911c-4b29-892e-89747d40d6b2
Aug 15 02:37:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-e5f1610c-cc30-4ff5-90c7-e0ea48c87245 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466 tempest-TestServerVolumeAttachScenarioOldVersion-1001782466-project-member] Lock "d25460df-911c-4b29-892e-89747d40d6b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.532s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:37:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:37:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:37:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:37:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid e7abf1e7-bf7b-42b7-b4db-6065cf312f6c {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:21 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692067026.0554988, d25460df-911c-4b29-892e-89747d40d6b2 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:37:21 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: d25460df-911c-4b29-892e-89747d40d6b2] VM Stopped (Lifecycle Event)
Aug 15 02:37:21 user nova-compute[73121]: DEBUG nova.compute.manager [None req-0e8872de-fa7b-4089-ba7e-208d01b83702 None None] [instance: d25460df-911c-4b29-892e-89747d40d6b2] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:37:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:37:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:25 user nova-compute[73121]: INFO nova.compute.manager [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Terminating instance
Aug 15 02:37:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:37:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d467fa3-e682-49de-9283-3f424833d10f req-352a4d55-23d1-4be9-91d1-a7515bc10012 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-unplugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d467fa3-e682-49de-9283-3f424833d10f req-352a4d55-23d1-4be9-91d1-a7515bc10012 service nova] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d467fa3-e682-49de-9283-3f424833d10f req-352a4d55-23d1-4be9-91d1-a7515bc10012 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-3d467fa3-e682-49de-9283-3f424833d10f req-352a4d55-23d1-4be9-91d1-a7515bc10012 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d467fa3-e682-49de-9283-3f424833d10f req-352a4d55-23d1-4be9-91d1-a7515bc10012 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] No waiting events found dispatching network-vif-unplugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-3d467fa3-e682-49de-9283-3f424833d10f req-352a4d55-23d1-4be9-91d1-a7515bc10012 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-unplugged-d0508681-b710-480c-9533-73fdf1cb3d7d for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Instance destroyed successfully.
Aug 15 02:37:26 user nova-compute[73121]: DEBUG nova.objects.instance [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'resources' on Instance uuid 22339f3c-9ef1-4630-94c2-a56f0b97aba6 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:21:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-841237313',display_name='tempest-ServerRescueNegativeTestJSON-server-841237313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-841237313',id=43,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:23:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-t8g0dkoe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:23:00Z,user_data=None,user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=22339f3c-9ef1-4630-94c2-a56f0b97aba6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "d0508681-b710-480c-9533-73fdf1cb3d7d", "address": "fa:16:3e:70:dc:15", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0508681-b7", "ovs_interfaceid": "d0508681-b710-480c-9533-73fdf1cb3d7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:dc:15,bridge_name='br-int',has_traffic_filtering=True,id=d0508681-b710-480c-9533-73fdf1cb3d7d,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0508681-b7') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG os_vif [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:dc:15,bridge_name='br-int',has_traffic_filtering=True,id=d0508681-b710-480c-9533-73fdf1cb3d7d,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0508681-b7') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0508681-b7, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:37:26 user nova-compute[73121]: INFO os_vif [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:dc:15,bridge_name='br-int',has_traffic_filtering=True,id=d0508681-b710-480c-9533-73fdf1cb3d7d,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0508681-b7')
Aug 15 02:37:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Deleting instance files /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6_del
Aug 15 02:37:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Deletion of /opt/stack/data/nova/instances/22339f3c-9ef1-4630-94c2-a56f0b97aba6_del complete
Aug 15 02:37:26 user nova-compute[73121]: INFO nova.compute.manager [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 15 02:37:26 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:37:26 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:37:27 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:37:27 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Took 0.42 seconds to deallocate network for instance.
Aug 15 02:37:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-d0b2f10f-72cc-44b3-a920-b6b306eeac26 req-6d10039b-5872-4cde-b019-52a42ed86e6c service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-deleted-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:37:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:27 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:37:27 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:37:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:27 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Deleted allocations for instance 22339f3c-9ef1-4630-94c2-a56f0b97aba6
Aug 15 02:37:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-af304d0a-03bb-4f10-86bf-829a658264c4 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.423s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-1be2a2cd-38aa-4a5f-9ddd-84692f4215ab req-dd975cba-11b2-4e93-9b00-02b3c1fd0703 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:37:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1be2a2cd-38aa-4a5f-9ddd-84692f4215ab req-dd975cba-11b2-4e93-9b00-02b3c1fd0703 service nova] Acquiring lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1be2a2cd-38aa-4a5f-9ddd-84692f4215ab req-dd975cba-11b2-4e93-9b00-02b3c1fd0703 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1be2a2cd-38aa-4a5f-9ddd-84692f4215ab req-dd975cba-11b2-4e93-9b00-02b3c1fd0703 service nova] Lock "22339f3c-9ef1-4630-94c2-a56f0b97aba6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:28 user nova-compute[73121]: DEBUG nova.compute.manager [req-1be2a2cd-38aa-4a5f-9ddd-84692f4215ab req-dd975cba-11b2-4e93-9b00-02b3c1fd0703 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] No waiting events found dispatching network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:37:28 user nova-compute[73121]: WARNING nova.compute.manager [req-1be2a2cd-38aa-4a5f-9ddd-84692f4215ab req-dd975cba-11b2-4e93-9b00-02b3c1fd0703 service nova] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Received unexpected event network-vif-plugged-d0508681-b710-480c-9533-73fdf1cb3d7d for instance with vm_state deleted and task_state None.
Aug 15 02:37:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:37:41 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:37:41 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692067046.5095344, 22339f3c-9ef1-4630-94c2-a56f0b97aba6 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:37:41 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] VM Stopped (Lifecycle Event)
Aug 15 02:37:41 user nova-compute[73121]: DEBUG nova.compute.manager [None req-5ec1af95-b933-48b8-8d26-0c8d8be69379 None None] [instance: 22339f3c-9ef1-4630-94c2-a56f0b97aba6] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:37:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:37:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:37:47 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:47 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:49 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:37:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:37:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:37:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:37:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:37:51 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8535MB free_disk=25.238388061523438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance e7abf1e7-bf7b-42b7-b4db-6065cf312f6c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:37:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:37:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:37:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:37:59 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquiring lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquiring lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:02 user nova-compute[73121]: INFO nova.compute.manager [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Terminating instance
Aug 15 02:38:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-bd5816d0-6016-4005-b9a3-9e9b0e7593a0 req-055140cd-3d37-40fd-a60e-b1c1b471f295 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received event network-vif-unplugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bd5816d0-6016-4005-b9a3-9e9b0e7593a0 req-055140cd-3d37-40fd-a60e-b1c1b471f295 service nova] Acquiring lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bd5816d0-6016-4005-b9a3-9e9b0e7593a0 req-055140cd-3d37-40fd-a60e-b1c1b471f295 service nova] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-bd5816d0-6016-4005-b9a3-9e9b0e7593a0 req-055140cd-3d37-40fd-a60e-b1c1b471f295 service nova] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-bd5816d0-6016-4005-b9a3-9e9b0e7593a0 req-055140cd-3d37-40fd-a60e-b1c1b471f295 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] No waiting events found dispatching network-vif-unplugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG nova.compute.manager [req-bd5816d0-6016-4005-b9a3-9e9b0e7593a0 req-055140cd-3d37-40fd-a60e-b1c1b471f295 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received event network-vif-unplugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Instance destroyed successfully.
Aug 15 02:38:03 user nova-compute[73121]: DEBUG nova.objects.instance [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lazy-loading 'resources' on Instance uuid e7abf1e7-bf7b-42b7-b4db-6065cf312f6c {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:36:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-502671766',display_name='tempest-VolumesActionsTest-instance-502671766',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-502671766',id=50,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0219a655be74e95b1027021e2670bcd',ramdisk_id='',reservation_id='r-irpw66jz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-760364533',owner_user_name='tempest-VolumesActionsTest-760364533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:36:09Z,user_data=None,user_id='0ff1d8a1832b41f19f75a0aec9629f65',uuid=e7abf1e7-bf7b-42b7-b4db-6065cf312f6c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Converting VIF {"id": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "address": "fa:16:3e:96:87:c3", "network": {"id": "ea020078-ba99-410b-8c27-1210f719c009", "bridge": "br-int", "label": "tempest-VolumesActionsTest-996176-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f0219a655be74e95b1027021e2670bcd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f8b1dcb-bf", "ovs_interfaceid": "4f8b1dcb-bfd3-4b6d-8f3f-085186a79179", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:87:c3,bridge_name='br-int',has_traffic_filtering=True,id=4f8b1dcb-bfd3-4b6d-8f3f-085186a79179,network=Network(ea020078-ba99-410b-8c27-1210f719c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8b1dcb-bf') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG os_vif [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:87:c3,bridge_name='br-int',has_traffic_filtering=True,id=4f8b1dcb-bfd3-4b6d-8f3f-085186a79179,network=Network(ea020078-ba99-410b-8c27-1210f719c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8b1dcb-bf') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f8b1dcb-bf, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:38:03 user nova-compute[73121]: INFO os_vif [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:87:c3,bridge_name='br-int',has_traffic_filtering=True,id=4f8b1dcb-bfd3-4b6d-8f3f-085186a79179,network=Network(ea020078-ba99-410b-8c27-1210f719c009),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f8b1dcb-bf')
Aug 15 02:38:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Deleting instance files /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c_del
Aug 15 02:38:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Deletion of /opt/stack/data/nova/instances/e7abf1e7-bf7b-42b7-b4db-6065cf312f6c_del complete
Aug 15 02:38:03 user nova-compute[73121]: INFO nova.compute.manager [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 02:38:03 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:38:03 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:38:04 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:38:04 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Took 0.46 seconds to deallocate network for instance.
Aug 15 02:38:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-d213869a-62bd-4980-8826-6adce2abd84a req-c13d337a-1c8a-4e6c-b31b-aee8d40a845f service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received event network-vif-deleted-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:38:04 user nova-compute[73121]: INFO nova.compute.manager [req-d213869a-62bd-4980-8826-6adce2abd84a req-c13d337a-1c8a-4e6c-b31b-aee8d40a845f service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Neutron deleted interface 4f8b1dcb-bfd3-4b6d-8f3f-085186a79179; detaching it from the instance and deleting it from the info cache
Aug 15 02:38:04 user nova-compute[73121]: DEBUG nova.network.neutron [req-d213869a-62bd-4980-8826-6adce2abd84a req-c13d337a-1c8a-4e6c-b31b-aee8d40a845f service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:38:04 user nova-compute[73121]: DEBUG nova.compute.manager [req-d213869a-62bd-4980-8826-6adce2abd84a req-c13d337a-1c8a-4e6c-b31b-aee8d40a845f service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Detach interface failed, port_id=4f8b1dcb-bfd3-4b6d-8f3f-085186a79179, reason: Instance e7abf1e7-bf7b-42b7-b4db-6065cf312f6c could not be found. {{(pid=73121) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 02:38:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:04 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:38:04 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:38:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:04 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Deleted allocations for instance e7abf1e7-bf7b-42b7-b4db-6065cf312f6c
Aug 15 02:38:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-19e836b4-c6a3-49f2-83da-3928624b59ba tempest-VolumesActionsTest-760364533 tempest-VolumesActionsTest-760364533-project-member] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-5aa0131e-c1c2-48af-aed9-edf32146494c req-2e3be33e-2b8e-481f-9605-2f1c5cd08984 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received event network-vif-plugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:38:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5aa0131e-c1c2-48af-aed9-edf32146494c req-2e3be33e-2b8e-481f-9605-2f1c5cd08984 service nova] Acquiring lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5aa0131e-c1c2-48af-aed9-edf32146494c req-2e3be33e-2b8e-481f-9605-2f1c5cd08984 service nova] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5aa0131e-c1c2-48af-aed9-edf32146494c req-2e3be33e-2b8e-481f-9605-2f1c5cd08984 service nova] Lock "e7abf1e7-bf7b-42b7-b4db-6065cf312f6c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:05 user nova-compute[73121]: DEBUG nova.compute.manager [req-5aa0131e-c1c2-48af-aed9-edf32146494c req-2e3be33e-2b8e-481f-9605-2f1c5cd08984 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] No waiting events found dispatching network-vif-plugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:38:05 user nova-compute[73121]: WARNING nova.compute.manager [req-5aa0131e-c1c2-48af-aed9-edf32146494c req-2e3be33e-2b8e-481f-9605-2f1c5cd08984 service nova] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Received unexpected event network-vif-plugged-4f8b1dcb-bfd3-4b6d-8f3f-085186a79179 for instance with vm_state deleted and task_state None.
Aug 15 02:38:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:14 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:16 user nova-compute[73121]: INFO nova.compute.manager [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Terminating instance
Aug 15 02:38:16 user nova-compute[73121]: DEBUG nova.compute.manager [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Instance destroyed successfully.
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.objects.instance [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lazy-loading 'resources' on Instance uuid 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1658867354',display_name='tempest-ServerRescueNegativeTestJSON-server-1658867354',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1658867354',id=42,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:25:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c202114f5c584284a72d52cececc4b34',ramdisk_id='',reservation_id='r-9i9zxafu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-704093322',owner_user_name='tempest-ServerRescueNegativeTestJSON-704093322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:27:45Z,user_data=None,user_id='c5012859ad374ac0b441cc5a5739cf4e',uuid=6ecfcc84-d915-4eac-bbf6-9ab2b5782088,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converting VIF {"id": "db197fcc-d147-49fa-9c46-9f330534c0e6", "address": "fa:16:3e:bc:b9:e2", "network": {"id": "6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2102932527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c202114f5c584284a72d52cececc4b34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb197fcc-d1", "ovs_interfaceid": "db197fcc-d147-49fa-9c46-9f330534c0e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b9:e2,bridge_name='br-int',has_traffic_filtering=True,id=db197fcc-d147-49fa-9c46-9f330534c0e6,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb197fcc-d1') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG os_vif [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b9:e2,bridge_name='br-int',has_traffic_filtering=True,id=db197fcc-d147-49fa-9c46-9f330534c0e6,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb197fcc-d1') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb197fcc-d1, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:38:17 user nova-compute[73121]: INFO os_vif [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:b9:e2,bridge_name='br-int',has_traffic_filtering=True,id=db197fcc-d147-49fa-9c46-9f330534c0e6,network=Network(6fb975e2-b9ab-4b8a-8c4b-1a7dea581c1a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb197fcc-d1')
Aug 15 02:38:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Deleting instance files /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088_del
Aug 15 02:38:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Deletion of /opt/stack/data/nova/instances/6ecfcc84-d915-4eac-bbf6-9ab2b5782088_del complete
Aug 15 02:38:17 user nova-compute[73121]: INFO nova.compute.manager [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 02:38:17 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:38:17 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Took 0.44 seconds to deallocate network for instance.
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.compute.manager [req-da906bbc-44f5-4b77-973c-c8166fe7fcd8 req-5df7b5bd-7402-4cee-ba94-37fa0ffad83a service nova] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Received event network-vif-deleted-db197fcc-d147-49fa-9c46-9f330534c0e6 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:38:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:17 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Deleted allocations for instance 6ecfcc84-d915-4eac-bbf6-9ab2b5782088
Aug 15 02:38:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-079b0878-47d6-4527-b3d4-fdcac4bc25a6 tempest-ServerRescueNegativeTestJSON-704093322 tempest-ServerRescueNegativeTestJSON-704093322-project-member] Lock "6ecfcc84-d915-4eac-bbf6-9ab2b5782088" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.594s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:18 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692067083.6356995, e7abf1e7-bf7b-42b7-b4db-6065cf312f6c => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:38:18 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] VM Stopped (Lifecycle Event)
Aug 15 02:38:18 user nova-compute[73121]: DEBUG nova.compute.manager [None req-c46623ad-d8c6-4636-bec8-4a93e2bfda88 None None] [instance: e7abf1e7-bf7b-42b7-b4db-6065cf312f6c] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:38:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:38:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:19 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:38:19 user nova-compute[73121]: INFO nova.compute.claims [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Claim successful on node user
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.185s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:38:20 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:38:20 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Creating image(s)
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "/opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "/opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "/opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.226s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.policy [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd01d2e58f2040999ecf659c65758d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83265e420b174e6796695180a3924727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk 1073741824" returned: 0 in 0.049s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Checking if we can resize image /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:38:20 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Cannot resize image /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'migration_context' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Ensure instance console log exists: /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Successfully created port: 694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:38:21 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Successfully updated port: 694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquired lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-1fdb648c-2d85-41af-962c-2cc7378c0368 req-91d0d4d1-8b01-4cd2-8ed8-577a48e553ff service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received event network-changed-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.compute.manager [req-1fdb648c-2d85-41af-962c-2cc7378c0368 req-91d0d4d1-8b01-4cd2-8ed8-577a48e553ff service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Refreshing instance network info cache due to event network-changed-694c5b95-ee73-4d6c-8607-9d204cbfadd0. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1fdb648c-2d85-41af-962c-2cc7378c0368 req-91d0d4d1-8b01-4cd2-8ed8-577a48e553ff service nova] Acquiring lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.neutron [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Releasing lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Instance network_info: |[{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1fdb648c-2d85-41af-962c-2cc7378c0368 req-91d0d4d1-8b01-4cd2-8ed8-577a48e553ff service nova] Acquired lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.neutron [req-1fdb648c-2d85-41af-962c-2cc7378c0368 req-91d0d4d1-8b01-4cd2-8ed8-577a48e553ff service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Refreshing network info cache for port 694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Start _get_guest_xml network_info=[{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:38:22 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:38:22 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-932784771',display_name='tempest-TestStampPattern-server-932784771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-932784771',id=51,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkYM7k2d5IuMu0HFImfPQ1+dqB9Da59A2YzjIYpVpaa7Vbn2GVoYI2pfv1m0t8UlfXdzXKstBGWaE6ZMlQA6cAvqHCoWMkay5mjXQ+5tZySW3MLxrhOuk6524ND3ubquA==',key_name='tempest-TestStampPattern-1702586286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83265e420b174e6796695180a3924727',ramdisk_id='',reservation_id='r-ur9g0xd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1035776336',owner_user_name='tempest-TestStampPattern-1035776336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:38:20Z,user_data=None,user_id='bd01d2e58f2040999ecf659c65758d51',uuid=530cca0d-7669-4ffb-ada0-c63283e6a529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converting VIF {"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5a:88,bridge_name='br-int',has_traffic_filtering=True,id=694c5b95-ee73-4d6c-8607-9d204cbfadd0,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694c5b95-ee') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'pci_devices' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:38:22 user nova-compute[73121]:   <uuid>530cca0d-7669-4ffb-ada0-c63283e6a529</uuid>
Aug 15 02:38:22 user nova-compute[73121]:   <name>instance-00000033</name>
Aug 15 02:38:22 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:38:22 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:38:22 user nova-compute[73121]:   <metadata>
Aug 15 02:38:22 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:38:22 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:38:22 user nova-compute[73121]:       <nova:name>tempest-TestStampPattern-server-932784771</nova:name>
Aug 15 02:38:22 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:38:22</nova:creationTime>
Aug 15 02:38:22 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:38:22 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:38:22 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:38:22 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:38:22 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:38:22 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:38:22 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:38:22 user nova-compute[73121]:       <nova:owner>
Aug 15 02:38:22 user nova-compute[73121]:         <nova:user uuid="bd01d2e58f2040999ecf659c65758d51">tempest-TestStampPattern-1035776336-project-member</nova:user>
Aug 15 02:38:22 user nova-compute[73121]:         <nova:project uuid="83265e420b174e6796695180a3924727">tempest-TestStampPattern-1035776336</nova:project>
Aug 15 02:38:22 user nova-compute[73121]:       </nova:owner>
Aug 15 02:38:22 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:38:22 user nova-compute[73121]:       <nova:ports>
Aug 15 02:38:22 user nova-compute[73121]:         <nova:port uuid="694c5b95-ee73-4d6c-8607-9d204cbfadd0">
Aug 15 02:38:22 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 02:38:22 user nova-compute[73121]:         </nova:port>
Aug 15 02:38:22 user nova-compute[73121]:       </nova:ports>
Aug 15 02:38:22 user nova-compute[73121]:     </nova:instance>
Aug 15 02:38:22 user nova-compute[73121]:   </metadata>
Aug 15 02:38:22 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:38:22 user nova-compute[73121]:     <system>
Aug 15 02:38:22 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:38:22 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:38:22 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:38:22 user nova-compute[73121]:       <entry name="serial">530cca0d-7669-4ffb-ada0-c63283e6a529</entry>
Aug 15 02:38:22 user nova-compute[73121]:       <entry name="uuid">530cca0d-7669-4ffb-ada0-c63283e6a529</entry>
Aug 15 02:38:22 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:38:22 user nova-compute[73121]:     </system>
Aug 15 02:38:22 user nova-compute[73121]:   </sysinfo>
Aug 15 02:38:22 user nova-compute[73121]:   <os>
Aug 15 02:38:22 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:38:22 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:38:22 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:38:22 user nova-compute[73121]:   </os>
Aug 15 02:38:22 user nova-compute[73121]:   <features>
Aug 15 02:38:22 user nova-compute[73121]:     <acpi/>
Aug 15 02:38:22 user nova-compute[73121]:     <apic/>
Aug 15 02:38:22 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:38:22 user nova-compute[73121]:   </features>
Aug 15 02:38:22 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:38:22 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:38:22 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:38:22 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:38:22 user nova-compute[73121]:   </clock>
Aug 15 02:38:22 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:38:22 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:38:22 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:38:22 user nova-compute[73121]:   </cpu>
Aug 15 02:38:22 user nova-compute[73121]:   <devices>
Aug 15 02:38:22 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:38:22 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:38:22 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk"/>
Aug 15 02:38:22 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:38:22 user nova-compute[73121]:     </disk>
Aug 15 02:38:22 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:38:22 user nova-compute[73121]:       <mac address="fa:16:3e:4e:5a:88"/>
Aug 15 02:38:22 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:38:22 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:38:22 user nova-compute[73121]:       <target dev="tap694c5b95-ee"/>
Aug 15 02:38:22 user nova-compute[73121]:     </interface>
Aug 15 02:38:22 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:38:22 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/console.log" append="off"/>
Aug 15 02:38:22 user nova-compute[73121]:     </serial>
Aug 15 02:38:22 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:38:22 user nova-compute[73121]:     <video>
Aug 15 02:38:22 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:38:22 user nova-compute[73121]:     </video>
Aug 15 02:38:22 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:38:22 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:38:22 user nova-compute[73121]:     </rng>
Aug 15 02:38:22 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:38:22 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:38:22 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:38:22 user nova-compute[73121]:     </memballoon>
Aug 15 02:38:22 user nova-compute[73121]:   </devices>
Aug 15 02:38:22 user nova-compute[73121]: </domain>
Aug 15 02:38:22 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-932784771',display_name='tempest-TestStampPattern-server-932784771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-932784771',id=51,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkYM7k2d5IuMu0HFImfPQ1+dqB9Da59A2YzjIYpVpaa7Vbn2GVoYI2pfv1m0t8UlfXdzXKstBGWaE6ZMlQA6cAvqHCoWMkay5mjXQ+5tZySW3MLxrhOuk6524ND3ubquA==',key_name='tempest-TestStampPattern-1702586286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83265e420b174e6796695180a3924727',ramdisk_id='',reservation_id='r-ur9g0xd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1035776336',owner_user_name='tempest-TestStampPattern-1035776336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:38:20Z,user_data=None,user_id='bd01d2e58f2040999ecf659c65758d51',uuid=530cca0d-7669-4ffb-ada0-c63283e6a529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converting VIF {"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5a:88,bridge_name='br-int',has_traffic_filtering=True,id=694c5b95-ee73-4d6c-8607-9d204cbfadd0,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694c5b95-ee') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG os_vif [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5a:88,bridge_name='br-int',has_traffic_filtering=True,id=694c5b95-ee73-4d6c-8607-9d204cbfadd0,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694c5b95-ee') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap694c5b95-ee, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap694c5b95-ee, col_values=(('external_ids', {'iface-id': '694c5b95-ee73-4d6c-8607-9d204cbfadd0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:5a:88', 'vm-uuid': '530cca0d-7669-4ffb-ada0-c63283e6a529'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:22 user nova-compute[73121]: INFO os_vif [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:5a:88,bridge_name='br-int',has_traffic_filtering=True,id=694c5b95-ee73-4d6c-8607-9d204cbfadd0,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694c5b95-ee')
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No VIF found with MAC fa:16:3e:4e:5a:88, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.neutron [req-1fdb648c-2d85-41af-962c-2cc7378c0368 req-91d0d4d1-8b01-4cd2-8ed8-577a48e553ff service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updated VIF entry in instance network info cache for port 694c5b95-ee73-4d6c-8607-9d204cbfadd0. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG nova.network.neutron [req-1fdb648c-2d85-41af-962c-2cc7378c0368 req-91d0d4d1-8b01-4cd2-8ed8-577a48e553ff service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:38:22 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1fdb648c-2d85-41af-962c-2cc7378c0368 req-91d0d4d1-8b01-4cd2-8ed8-577a48e553ff service nova] Releasing lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:38:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:24 user nova-compute[73121]: DEBUG nova.compute.manager [req-521945ab-c7fb-4694-b079-0a44d9133f93 req-2b7d705e-ec3b-4349-ae67-ca1cdd6de771 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received event network-vif-plugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:38:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-521945ab-c7fb-4694-b079-0a44d9133f93 req-2b7d705e-ec3b-4349-ae67-ca1cdd6de771 service nova] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-521945ab-c7fb-4694-b079-0a44d9133f93 req-2b7d705e-ec3b-4349-ae67-ca1cdd6de771 service nova] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-521945ab-c7fb-4694-b079-0a44d9133f93 req-2b7d705e-ec3b-4349-ae67-ca1cdd6de771 service nova] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:24 user nova-compute[73121]: DEBUG nova.compute.manager [req-521945ab-c7fb-4694-b079-0a44d9133f93 req-2b7d705e-ec3b-4349-ae67-ca1cdd6de771 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] No waiting events found dispatching network-vif-plugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:38:24 user nova-compute[73121]: WARNING nova.compute.manager [req-521945ab-c7fb-4694-b079-0a44d9133f93 req-2b7d705e-ec3b-4349-ae67-ca1cdd6de771 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received unexpected event network-vif-plugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 for instance with vm_state building and task_state spawning.
Aug 15 02:38:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:24 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692067105.8364081, 530cca0d-7669-4ffb-ada0-c63283e6a529 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:38:25 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] VM Resumed (Lifecycle Event)
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:38:25 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Instance spawned successfully.
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:38:25 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692067105.8378942, 530cca0d-7669-4ffb-ada0-c63283e6a529 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:38:25 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] VM Started (Lifecycle Event)
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:38:25 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:38:25 user nova-compute[73121]: INFO nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Took 5.70 seconds to spawn the instance on the hypervisor.
Aug 15 02:38:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:38:26 user nova-compute[73121]: INFO nova.compute.manager [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Took 6.19 seconds to build instance.
Aug 15 02:38:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ec40a2e8-0848-4486-b89d-2f0600fc5877 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.282s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-6bf49f5c-80a8-4f97-ab2c-3ab91e228cf0 req-5a9fa2fc-5b06-420e-b21f-afcb07ba3b9e service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received event network-vif-plugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:38:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6bf49f5c-80a8-4f97-ab2c-3ab91e228cf0 req-5a9fa2fc-5b06-420e-b21f-afcb07ba3b9e service nova] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6bf49f5c-80a8-4f97-ab2c-3ab91e228cf0 req-5a9fa2fc-5b06-420e-b21f-afcb07ba3b9e service nova] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6bf49f5c-80a8-4f97-ab2c-3ab91e228cf0 req-5a9fa2fc-5b06-420e-b21f-afcb07ba3b9e service nova] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:26 user nova-compute[73121]: DEBUG nova.compute.manager [req-6bf49f5c-80a8-4f97-ab2c-3ab91e228cf0 req-5a9fa2fc-5b06-420e-b21f-afcb07ba3b9e service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] No waiting events found dispatching network-vif-plugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:38:26 user nova-compute[73121]: WARNING nova.compute.manager [req-6bf49f5c-80a8-4f97-ab2c-3ab91e228cf0 req-5a9fa2fc-5b06-420e-b21f-afcb07ba3b9e service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received unexpected event network-vif-plugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 for instance with vm_state active and task_state None.
Aug 15 02:38:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:32 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692067097.1761465, 6ecfcc84-d915-4eac-bbf6-9ab2b5782088 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:38:32 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] VM Stopped (Lifecycle Event)
Aug 15 02:38:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-95a16348-34cc-41d4-bdf1-5b45da82f9d5 None None] [instance: 6ecfcc84-d915-4eac-bbf6-9ab2b5782088] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:38:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:38:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:38:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:38:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:38:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:38:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:38:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:38:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:38:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:38:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:38:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:48 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:38:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:49 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:38:50 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:38:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:38:51 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:38:51 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=25.263187408447266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:38:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:38:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 530cca0d-7669-4ffb-ada0-c63283e6a529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:38:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:38:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:38:52 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:38:52 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:38:52 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:38:52 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:38:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:54 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:38:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:38:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:04 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:39:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:39:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:39:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:39:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:39:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:39:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:39:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:39:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:39:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:39:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:39:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:39:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:39:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:39:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:39:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:49 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:49 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:39:50 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:39:53 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:39:53 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:39:53 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8653MB free_disk=25.259517669677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:39:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:39:54 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 530cca0d-7669-4ffb-ada0-c63283e6a529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:39:54 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:39:54 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:39:54 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:39:54 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:39:54 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:39:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:39:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:39:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:40:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:40:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:40:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:40:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:40:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-ed6b247d-a9d5-4db9-81d2-ac70701ec4fd req-4bbc9edd-ee53-4ca6-9bef-b4173f9a6d0f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received event network-changed-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG nova.compute.manager [req-ed6b247d-a9d5-4db9-81d2-ac70701ec4fd req-4bbc9edd-ee53-4ca6-9bef-b4173f9a6d0f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Refreshing instance network info cache due to event network-changed-694c5b95-ee73-4d6c-8607-9d204cbfadd0. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ed6b247d-a9d5-4db9-81d2-ac70701ec4fd req-4bbc9edd-ee53-4ca6-9bef-b4173f9a6d0f service nova] Acquiring lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ed6b247d-a9d5-4db9-81d2-ac70701ec4fd req-4bbc9edd-ee53-4ca6-9bef-b4173f9a6d0f service nova] Acquired lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG nova.network.neutron [req-ed6b247d-a9d5-4db9-81d2-ac70701ec4fd req-4bbc9edd-ee53-4ca6-9bef-b4173f9a6d0f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Refreshing network info cache for port 694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG nova.objects.instance [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'flavor' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG nova.network.neutron [req-ed6b247d-a9d5-4db9-81d2-ac70701ec4fd req-4bbc9edd-ee53-4ca6-9bef-b4173f9a6d0f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updated VIF entry in instance network info cache for port 694c5b95-ee73-4d6c-8607-9d204cbfadd0. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG nova.network.neutron [req-ed6b247d-a9d5-4db9-81d2-ac70701ec4fd req-4bbc9edd-ee53-4ca6-9bef-b4173f9a6d0f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ed6b247d-a9d5-4db9-81d2-ac70701ec4fd req-4bbc9edd-ee53-4ca6-9bef-b4173f9a6d0f service nova] Releasing lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:40:12 user nova-compute[73121]: INFO nova.compute.manager [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Attaching volume 5bd601e1-0173-4892-ad3a-221285c72484 to /dev/vdb
Aug 15 02:40:12 user nova-compute[73121]: DEBUG os_brick.utils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a1bf67-cabb-45f4-ac48-6dbdc7458a70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[45921b76-a2e0-4135-9f33-41707f924a63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d254573-1da0-43ef-8a73-1daaa9c070f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaf4f3f-4392-4b2d-b2d8-09db596b7e57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:40:12 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:40:12 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c122dc8-cbc3-4518-aed9-5d684b1b1079]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG os_brick.utils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:40:12 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating existing volume attachment record: db655d6b-8f03-4da7-aa61-03c0ac15210f {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:40:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFNdSEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:40:21 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:40:21 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:40:21 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd69cecc-1993-4ce7-9a68-57e8cd1b1c60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:40:21 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eb31ce-b252-4250-9672-fdae64875e35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484] added
Aug 15 02:40:21 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[033570ae-08ee-4e23-abf0-a432a601d8fe]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e452b6b-4932-4cb8-98af-7935875dec5d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFNdSEYI {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tFNdSEYI" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbea29de-e4b3-415f-9942-67a00305ba61]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tFNdSEYI'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff614b-c920-41b9-ab0d-1481b06d4797]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[26af105e-a630-4e0a-9588-f288b6dbf2dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:40:21 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:40:21 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:40:21 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:40:21 user nova-compute[73121]: 
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[81eec139-3b20-4362-8e65-d72a4b255529]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484, portal: 172.16.0.220,3260]
Aug 15 02:40:22 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484, portal: 172.16.0.220,3260] successful.
Aug 15 02:40:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f23200f-3248-409b-9bf2-f76445fdebe2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[caccd8ae-486d-43a6-8a13-59411d78fb4f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 (non-flash)
Aug 15 02:40:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 (non-flash)
Aug 15 02:40:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[86947f1d-b8ce-4217-999f-3a2b1564e888]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:40:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFNdSEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26238386534663432', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238386534663432', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'flavor' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:40:23 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:40:23 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:40:23 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:40:23 user nova-compute[73121]:   <serial>5bd601e1-0173-4892-ad3a-221285c72484</serial>
Aug 15 02:40:23 user nova-compute[73121]: </disk>
Aug 15 02:40:23 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No VIF found with MAC fa:16:3e:4e:5a:88, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:40:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-36e0ff9b-54e9-4172-8f65-6008da1932c8 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.125s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:40:26 user nova-compute[73121]: INFO nova.compute.manager [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Detaching volume 5bd601e1-0173-4892-ad3a-221285c72484
Aug 15 02:40:26 user nova-compute[73121]: INFO nova.virt.block_device [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Attempting to driver detach volume 5bd601e1-0173-4892-ad3a-221285c72484 from mountpoint /dev/vdb
Aug 15 02:40:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Attempting to detach device vdb from instance 530cca0d-7669-4ffb-ada0-c63283e6a529 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:40:26 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:40:26 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:40:26 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:40:26 user nova-compute[73121]:   <serial>5bd601e1-0173-4892-ad3a-221285c72484</serial>
Aug 15 02:40:26 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:40:26 user nova-compute[73121]: </disk>
Aug 15 02:40:26 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:40:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Successfully detached device vdb from instance 530cca0d-7669-4ffb-ada0-c63283e6a529 from the persistent domain config.
Aug 15 02:40:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 530cca0d-7669-4ffb-ada0-c63283e6a529 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:40:26 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:40:26 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:40:26 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:40:26 user nova-compute[73121]:   <serial>5bd601e1-0173-4892-ad3a-221285c72484</serial>
Aug 15 02:40:26 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:40:26 user nova-compute[73121]: </disk>
Aug 15 02:40:26 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692067226.6013243, 530cca0d-7669-4ffb-ada0-c63283e6a529 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:40:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Successfully detached device vdb from instance 530cca0d-7669-4ffb-ada0-c63283e6a529 from the live domain config.
Aug 15 02:40:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tFNdSEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:40:26 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ca3c94-4a49-498d-8f9f-aac83855fe87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ffbb4b-2900-4b3f-8267-97a983babf7f]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 (non-flash)
Aug 15 02:40:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 (non-flash)
Aug 15 02:40:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc788160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac85b028-d070-4d0e-ac7c-aa86fbb57130]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f68be2-4d69-443d-a52e-49e8747c1059]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f71356f-d296-4219-a829-f1e98b7dbfbd]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ab0e19-4d16-4484-931c-82b7923d9478]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b936f2-3b64-4cfa-8baa-cf4a2316e40d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e946f5-dfbb-4f87-9807-60a291d798c4]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484, portal: 172.16.0.220,3260]
Aug 15 02:40:26 user nova-compute[73121]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484, portal: 172.16.0.220,3260] successful.
Aug 15 02:40:26 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bd601e1-0173-4892-ad3a-221285c72484 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad54b49c-2c86-40b9-86e5-f9d162784553]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] <== disconnect_volume: return (279ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:40:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:40:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:27 user nova-compute[73121]: DEBUG nova.objects.instance [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'flavor' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:40:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4be823e1-b16e-4c8a-9525-f65065e7f726 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:40:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:32 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:40:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:40:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:40:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:40:37 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:40:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:40:42 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:40:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:40:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:40:47 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:48 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:40:50 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:40:50 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:40:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:40:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:40:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:40:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:40:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:40:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:40:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:40:53 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:40:53 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:40:53 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8692MB free_disk=25.248371124267578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:40:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:40:54 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 530cca0d-7669-4ffb-ada0-c63283e6a529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:40:54 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:40:54 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:40:54 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:40:54 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:40:54 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:40:54 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:40:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:40:57 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:41:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:02 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:06 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:41:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:41:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:07 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:41:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:41:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:17 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:41:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:41:24 user nova-compute[73121]: INFO nova.compute.manager [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] instance snapshotting
Aug 15 02:41:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Beginning live snapshot process
Aug 15 02:41:24 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json -f qcow2 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json -f qcow2 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8jt74bvx/86b6df9dbe6f425dbf9734bc7ad021b0.delta 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8jt74bvx/86b6df9dbe6f425dbf9734bc7ad021b0.delta 1073741824" returned: 0 in 0.053s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:25 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 02:41:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:41:26 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73121) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 02:41:26 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 02:41:26 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:41:26 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8jt74bvx/86b6df9dbe6f425dbf9734bc7ad021b0.delta /opt/stack/data/nova/instances/snapshots/tmp8jt74bvx/86b6df9dbe6f425dbf9734bc7ad021b0 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:27 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8jt74bvx/86b6df9dbe6f425dbf9734bc7ad021b0.delta /opt/stack/data/nova/instances/snapshots/tmp8jt74bvx/86b6df9dbe6f425dbf9734bc7ad021b0" returned: 0 in 0.470s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:27 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Snapshot extracted, beginning image upload
Aug 15 02:41:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:41:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:41:29 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Snapshot image upload complete
Aug 15 02:41:29 user nova-compute[73121]: INFO nova.compute.manager [None req-6159ef50-13e2-43bd-baa4-3d911f974527 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Took 4.79 seconds to snapshot the instance on the hypervisor.
Aug 15 02:41:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:41:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:31 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:41:31 user nova-compute[73121]: INFO nova.compute.claims [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Claim successful on node user
Aug 15 02:41:31 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:41:31 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:41:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:31 user nova-compute[73121]: DEBUG nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:41:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:41:32 user nova-compute[73121]: DEBUG nova.network.neutron [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:41:32 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:41:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:41:32 user nova-compute[73121]: DEBUG nova.policy [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd01d2e58f2040999ecf659c65758d51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83265e420b174e6796695180a3924727', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:41:32 user nova-compute[73121]: DEBUG nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:41:32 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:41:32 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Creating image(s)
Aug 15 02:41:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "/opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "/opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "/opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "bca5b83a636bd35e06d50abc8222218c428d1ed8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "bca5b83a636bd35e06d50abc8222218c428d1ed8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8.part --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:33 user nova-compute[73121]: DEBUG nova.network.neutron [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Successfully created port: 788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:41:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8.part --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:33 user nova-compute[73121]: DEBUG nova.virt.images [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] 23d6c39a-9a0d-4cea-bc1c-e74535cd90d0 was qcow2, converting to raw {{(pid=73121) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 02:41:33 user nova-compute[73121]: DEBUG nova.privsep.utils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73121) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 02:41:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8.part /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8.converted {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8.part /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8.converted" returned: 0 in 0.663s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8.converted --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "bca5b83a636bd35e06d50abc8222218c428d1ed8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.094s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.network.neutron [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Successfully updated port: 788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8 --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "bca5b83a636bd35e06d50abc8222218c428d1ed8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "bca5b83a636bd35e06d50abc8222218c428d1ed8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquired lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.network.neutron [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-5b2f4a1b-9049-4c9d-b782-50e8332af4b8 req-b0e998f2-2784-4a68-857c-fe71ee5882b7 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received event network-changed-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.compute.manager [req-5b2f4a1b-9049-4c9d-b782-50e8332af4b8 req-b0e998f2-2784-4a68-857c-fe71ee5882b7 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Refreshing instance network info cache due to event network-changed-788858b0-db81-4a54-9722-4e8a7a9b6933. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5b2f4a1b-9049-4c9d-b782-50e8332af4b8 req-b0e998f2-2784-4a68-857c-fe71ee5882b7 service nova] Acquiring lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.network.neutron [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8 --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8,backing_fmt=raw /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8,backing_fmt=raw /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk 1073741824" returned: 0 in 0.051s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "bca5b83a636bd35e06d50abc8222218c428d1ed8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8 --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bca5b83a636bd35e06d50abc8222218c428d1ed8 --force-share --output=json" returned: 0 in 0.171s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.objects.instance [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'migration_context' on Instance uuid 63ff047d-d0e2-449d-a333-272e1d6f0e77 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Ensure instance console log exists: /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.network.neutron [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updating instance_info_cache with network_info: [{"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Releasing lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Instance network_info: |[{"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5b2f4a1b-9049-4c9d-b782-50e8332af4b8 req-b0e998f2-2784-4a68-857c-fe71ee5882b7 service nova] Acquired lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.network.neutron [req-5b2f4a1b-9049-4c9d-b782-50e8332af4b8 req-b0e998f2-2784-4a68-857c-fe71ee5882b7 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Refreshing network info cache for port 788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Start _get_guest_xml network_info=[{"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d3d5dd4e51d0194dff6c62e1a5e3d51f',container_format='bare',created_at=2023-08-15T02:41:24Z,direct_url=<?>,disk_format='qcow2',id=23d6c39a-9a0d-4cea-bc1c-e74535cd90d0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2023499287',owner='83265e420b174e6796695180a3924727',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T02:41:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': '23d6c39a-9a0d-4cea-bc1c-e74535cd90d0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:41:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:41:34 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d3d5dd4e51d0194dff6c62e1a5e3d51f',container_format='bare',created_at=2023-08-15T02:41:24Z,direct_url=<?>,disk_format='qcow2',id=23d6c39a-9a0d-4cea-bc1c-e74535cd90d0,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2023499287',owner='83265e420b174e6796695180a3924727',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T02:41:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:41:34 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1413747920',display_name='tempest-TestStampPattern-server-1413747920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1413747920',id=52,image_ref='23d6c39a-9a0d-4cea-bc1c-e74535cd90d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkYM7k2d5IuMu0HFImfPQ1+dqB9Da59A2YzjIYpVpaa7Vbn2GVoYI2pfv1m0t8UlfXdzXKstBGWaE6ZMlQA6cAvqHCoWMkay5mjXQ+5tZySW3MLxrhOuk6524ND3ubquA==',key_name='tempest-TestStampPattern-1702586286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83265e420b174e6796695180a3924727',ramdisk_id='',reservation_id='r-71qsojk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='530cca0d-7669-4ffb-ada0-c63283e6a529',image_min_disk='1',image_min_ram='0',image_owner_id='83265e420b174e6796695180a3924727',image_owner_project_name='tempest-TestStampPattern-1035776336',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1035776336-project-member',image_user_id='bd01d2e58f2040999ecf659c65758d51',network_allocated='True',owner_project_name='tempest-TestStampPattern-1035776336',owner_user_name='tempest-TestStampPattern-1035776336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:41:32Z,user_data=None,user_id='bd01d2e58f2040999ecf659c65758d51',uuid=63ff047d-d0e2-449d-a333-272e1d6f0e77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converting VIF {"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0f:25,bridge_name='br-int',has_traffic_filtering=True,id=788858b0-db81-4a54-9722-4e8a7a9b6933,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788858b0-db') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.objects.instance [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'pci_devices' on Instance uuid 63ff047d-d0e2-449d-a333-272e1d6f0e77 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:41:35 user nova-compute[73121]:   <uuid>63ff047d-d0e2-449d-a333-272e1d6f0e77</uuid>
Aug 15 02:41:35 user nova-compute[73121]:   <name>instance-00000034</name>
Aug 15 02:41:35 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:41:35 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:41:35 user nova-compute[73121]:   <metadata>
Aug 15 02:41:35 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:41:35 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:41:35 user nova-compute[73121]:       <nova:name>tempest-TestStampPattern-server-1413747920</nova:name>
Aug 15 02:41:35 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:41:34</nova:creationTime>
Aug 15 02:41:35 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:41:35 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:41:35 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:41:35 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:41:35 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:41:35 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:41:35 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:41:35 user nova-compute[73121]:       <nova:owner>
Aug 15 02:41:35 user nova-compute[73121]:         <nova:user uuid="bd01d2e58f2040999ecf659c65758d51">tempest-TestStampPattern-1035776336-project-member</nova:user>
Aug 15 02:41:35 user nova-compute[73121]:         <nova:project uuid="83265e420b174e6796695180a3924727">tempest-TestStampPattern-1035776336</nova:project>
Aug 15 02:41:35 user nova-compute[73121]:       </nova:owner>
Aug 15 02:41:35 user nova-compute[73121]:       <nova:root type="image" uuid="23d6c39a-9a0d-4cea-bc1c-e74535cd90d0"/>
Aug 15 02:41:35 user nova-compute[73121]:       <nova:ports>
Aug 15 02:41:35 user nova-compute[73121]:         <nova:port uuid="788858b0-db81-4a54-9722-4e8a7a9b6933">
Aug 15 02:41:35 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 02:41:35 user nova-compute[73121]:         </nova:port>
Aug 15 02:41:35 user nova-compute[73121]:       </nova:ports>
Aug 15 02:41:35 user nova-compute[73121]:     </nova:instance>
Aug 15 02:41:35 user nova-compute[73121]:   </metadata>
Aug 15 02:41:35 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:41:35 user nova-compute[73121]:     <system>
Aug 15 02:41:35 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:41:35 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:41:35 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:41:35 user nova-compute[73121]:       <entry name="serial">63ff047d-d0e2-449d-a333-272e1d6f0e77</entry>
Aug 15 02:41:35 user nova-compute[73121]:       <entry name="uuid">63ff047d-d0e2-449d-a333-272e1d6f0e77</entry>
Aug 15 02:41:35 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:41:35 user nova-compute[73121]:     </system>
Aug 15 02:41:35 user nova-compute[73121]:   </sysinfo>
Aug 15 02:41:35 user nova-compute[73121]:   <os>
Aug 15 02:41:35 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:41:35 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:41:35 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:41:35 user nova-compute[73121]:   </os>
Aug 15 02:41:35 user nova-compute[73121]:   <features>
Aug 15 02:41:35 user nova-compute[73121]:     <acpi/>
Aug 15 02:41:35 user nova-compute[73121]:     <apic/>
Aug 15 02:41:35 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:41:35 user nova-compute[73121]:   </features>
Aug 15 02:41:35 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:41:35 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:41:35 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:41:35 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:41:35 user nova-compute[73121]:   </clock>
Aug 15 02:41:35 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:41:35 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:41:35 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:41:35 user nova-compute[73121]:   </cpu>
Aug 15 02:41:35 user nova-compute[73121]:   <devices>
Aug 15 02:41:35 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:41:35 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:41:35 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk"/>
Aug 15 02:41:35 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:41:35 user nova-compute[73121]:     </disk>
Aug 15 02:41:35 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:41:35 user nova-compute[73121]:       <mac address="fa:16:3e:56:0f:25"/>
Aug 15 02:41:35 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:41:35 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:41:35 user nova-compute[73121]:       <target dev="tap788858b0-db"/>
Aug 15 02:41:35 user nova-compute[73121]:     </interface>
Aug 15 02:41:35 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:41:35 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/console.log" append="off"/>
Aug 15 02:41:35 user nova-compute[73121]:     </serial>
Aug 15 02:41:35 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:41:35 user nova-compute[73121]:     <video>
Aug 15 02:41:35 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:41:35 user nova-compute[73121]:     </video>
Aug 15 02:41:35 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:41:35 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:41:35 user nova-compute[73121]:     </rng>
Aug 15 02:41:35 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:41:35 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:41:35 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:41:35 user nova-compute[73121]:     </memballoon>
Aug 15 02:41:35 user nova-compute[73121]:   </devices>
Aug 15 02:41:35 user nova-compute[73121]: </domain>
Aug 15 02:41:35 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1413747920',display_name='tempest-TestStampPattern-server-1413747920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1413747920',id=52,image_ref='23d6c39a-9a0d-4cea-bc1c-e74535cd90d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkYM7k2d5IuMu0HFImfPQ1+dqB9Da59A2YzjIYpVpaa7Vbn2GVoYI2pfv1m0t8UlfXdzXKstBGWaE6ZMlQA6cAvqHCoWMkay5mjXQ+5tZySW3MLxrhOuk6524ND3ubquA==',key_name='tempest-TestStampPattern-1702586286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83265e420b174e6796695180a3924727',ramdisk_id='',reservation_id='r-71qsojk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='530cca0d-7669-4ffb-ada0-c63283e6a529',image_min_disk='1',image_min_ram='0',image_owner_id='83265e420b174e6796695180a3924727',image_owner_project_name='tempest-TestStampPattern-1035776336',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1035776336-project-member',image_user_id='bd01d2e58f2040999ecf659c65758d51',network_allocated='True',owner_project_name='tempest-TestStampPattern-1035776336',owner_user_name='tempest-TestStampPattern-1035776336-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:41:32Z,user_data=None,user_id='bd01d2e58f2040999ecf659c65758d51',uuid=63ff047d-d0e2-449d-a333-272e1d6f0e77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converting VIF {"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:0f:25,bridge_name='br-int',has_traffic_filtering=True,id=788858b0-db81-4a54-9722-4e8a7a9b6933,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788858b0-db') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG os_vif [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0f:25,bridge_name='br-int',has_traffic_filtering=True,id=788858b0-db81-4a54-9722-4e8a7a9b6933,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788858b0-db') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap788858b0-db, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap788858b0-db, col_values=(('external_ids', {'iface-id': '788858b0-db81-4a54-9722-4e8a7a9b6933', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:0f:25', 'vm-uuid': '63ff047d-d0e2-449d-a333-272e1d6f0e77'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:35 user nova-compute[73121]: INFO os_vif [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:0f:25,bridge_name='br-int',has_traffic_filtering=True,id=788858b0-db81-4a54-9722-4e8a7a9b6933,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788858b0-db')
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No VIF found with MAC fa:16:3e:56:0f:25, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.network.neutron [req-5b2f4a1b-9049-4c9d-b782-50e8332af4b8 req-b0e998f2-2784-4a68-857c-fe71ee5882b7 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updated VIF entry in instance network info cache for port 788858b0-db81-4a54-9722-4e8a7a9b6933. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG nova.network.neutron [req-5b2f4a1b-9049-4c9d-b782-50e8332af4b8 req-b0e998f2-2784-4a68-857c-fe71ee5882b7 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updating instance_info_cache with network_info: [{"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:41:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-5b2f4a1b-9049-4c9d-b782-50e8332af4b8 req-b0e998f2-2784-4a68-857c-fe71ee5882b7 service nova] Releasing lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:41:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-fae7174b-e01e-4dc4-8f8c-7181cafb2785 req-26881991-6d28-4168-a1e4-28db35fac31a service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received event network-vif-plugged-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:41:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fae7174b-e01e-4dc4-8f8c-7181cafb2785 req-26881991-6d28-4168-a1e4-28db35fac31a service nova] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fae7174b-e01e-4dc4-8f8c-7181cafb2785 req-26881991-6d28-4168-a1e4-28db35fac31a service nova] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-fae7174b-e01e-4dc4-8f8c-7181cafb2785 req-26881991-6d28-4168-a1e4-28db35fac31a service nova] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:36 user nova-compute[73121]: DEBUG nova.compute.manager [req-fae7174b-e01e-4dc4-8f8c-7181cafb2785 req-26881991-6d28-4168-a1e4-28db35fac31a service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] No waiting events found dispatching network-vif-plugged-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:41:36 user nova-compute[73121]: WARNING nova.compute.manager [req-fae7174b-e01e-4dc4-8f8c-7181cafb2785 req-26881991-6d28-4168-a1e4-28db35fac31a service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received unexpected event network-vif-plugged-788858b0-db81-4a54-9722-4e8a7a9b6933 for instance with vm_state building and task_state spawning.
Aug 15 02:41:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692067298.5406008, 63ff047d-d0e2-449d-a333-272e1d6f0e77 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:41:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] VM Resumed (Lifecycle Event)
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:41:38 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Instance spawned successfully.
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:41:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692067298.541693, 63ff047d-d0e2-449d-a333-272e1d6f0e77 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:41:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] VM Started (Lifecycle Event)
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:41:38 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:41:38 user nova-compute[73121]: INFO nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Took 6.43 seconds to spawn the instance on the hypervisor.
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:41:38 user nova-compute[73121]: INFO nova.compute.manager [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Took 6.99 seconds to build instance.
Aug 15 02:41:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-94c29f04-b243-421d-8340-a2f2d0af6c66 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.083s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-adf8f0a9-8297-4a14-81c1-e9e466e53e76 req-6a0a1fbe-62fd-4708-90c9-b5d86a0c92d3 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received event network-vif-plugged-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-adf8f0a9-8297-4a14-81c1-e9e466e53e76 req-6a0a1fbe-62fd-4708-90c9-b5d86a0c92d3 service nova] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-adf8f0a9-8297-4a14-81c1-e9e466e53e76 req-6a0a1fbe-62fd-4708-90c9-b5d86a0c92d3 service nova] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-adf8f0a9-8297-4a14-81c1-e9e466e53e76 req-6a0a1fbe-62fd-4708-90c9-b5d86a0c92d3 service nova] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:38 user nova-compute[73121]: DEBUG nova.compute.manager [req-adf8f0a9-8297-4a14-81c1-e9e466e53e76 req-6a0a1fbe-62fd-4708-90c9-b5d86a0c92d3 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] No waiting events found dispatching network-vif-plugged-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:41:38 user nova-compute[73121]: WARNING nova.compute.manager [req-adf8f0a9-8297-4a14-81c1-e9e466e53e76 req-6a0a1fbe-62fd-4708-90c9-b5d86a0c92d3 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received unexpected event network-vif-plugged-788858b0-db81-4a54-9722-4e8a7a9b6933 for instance with vm_state active and task_state None.
Aug 15 02:41:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:42 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:41:42 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:41:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:41:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:48 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:41:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:41:50 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:41:51 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:41:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:41:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:41:55 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:41:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:41:56 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8647MB free_disk=25.102523803710938GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 530cca0d-7669-4ffb-ada0-c63283e6a529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 63ff047d-d0e2-449d-a333-272e1d6f0e77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:41:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:41:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:41:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:42:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:42:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:11 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:42:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:42:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:42:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:42:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:42:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:42:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:42:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:42:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:42:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:42:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:42:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:42:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:42:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:42:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:42:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:42:43 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:42:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:42:48 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:51 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:42:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:42:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:42:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:42:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updating instance_info_cache with network_info: [{"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:42:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:42:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:42:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:42:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:42:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:42:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:42:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:42:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json" returned: 0 in 0.499s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:42:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:42:57 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:42:57 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:42:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=25.1014404296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 530cca0d-7669-4ffb-ada0-c63283e6a529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 63ff047d-d0e2-449d-a333-272e1d6f0e77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:42:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:42:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:43:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:43:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:43:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-d92ea982-4798-4440-be3e-848a15fae359 req-4ccca939-3c0a-44c1-9de2-df9366688484 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received event network-changed-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:43:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-d92ea982-4798-4440-be3e-848a15fae359 req-4ccca939-3c0a-44c1-9de2-df9366688484 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Refreshing instance network info cache due to event network-changed-788858b0-db81-4a54-9722-4e8a7a9b6933. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:43:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d92ea982-4798-4440-be3e-848a15fae359 req-4ccca939-3c0a-44c1-9de2-df9366688484 service nova] Acquiring lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:43:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d92ea982-4798-4440-be3e-848a15fae359 req-4ccca939-3c0a-44c1-9de2-df9366688484 service nova] Acquired lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:43:23 user nova-compute[73121]: DEBUG nova.network.neutron [req-d92ea982-4798-4440-be3e-848a15fae359 req-4ccca939-3c0a-44c1-9de2-df9366688484 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Refreshing network info cache for port 788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:43:23 user nova-compute[73121]: DEBUG nova.network.neutron [req-d92ea982-4798-4440-be3e-848a15fae359 req-4ccca939-3c0a-44c1-9de2-df9366688484 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updated VIF entry in instance network info cache for port 788858b0-db81-4a54-9722-4e8a7a9b6933. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:43:23 user nova-compute[73121]: DEBUG nova.network.neutron [req-d92ea982-4798-4440-be3e-848a15fae359 req-4ccca939-3c0a-44c1-9de2-df9366688484 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updating instance_info_cache with network_info: [{"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:43:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-d92ea982-4798-4440-be3e-848a15fae359 req-4ccca939-3c0a-44c1-9de2-df9366688484 service nova] Releasing lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:43:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:43:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:43:24 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'flavor' on Instance uuid 63ff047d-d0e2-449d-a333-272e1d6f0e77 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:43:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:43:25 user nova-compute[73121]: INFO nova.compute.manager [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Attaching volume 43874607-8a87-471a-b96f-c7f58b2dc444 to /dev/vdb
Aug 15 02:43:25 user nova-compute[73121]: DEBUG os_brick.utils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98383d3-010f-45a6-936c-1b6ad6b36646]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed15c4-ddba-4501-ae67-3c24ab93c381]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bb5de9-cc0e-4932-aa7a-0d7154662ea7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[735da63d-f21e-482b-8823-1ebc973192de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:43:25 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:43:25 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[774f3eb0-c907-471f-9039-166f1f51dd01]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG os_brick.utils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:43:25 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updating existing volume attachment record: 116231a0-54ca-4bb9-ab0b-4cd83621726a {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:43:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:33 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:43:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJkyXbZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:43:33 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:43:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:43:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:43:33 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:43:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:43:33 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:43:33 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:43:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:33 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:33 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef819d21-e906-485d-9aa0-7ba1ddf0e518]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:43:34 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2580c5f-804c-41c4-a066-1f1c0a80fa82]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444] added
Aug 15 02:43:34 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3354917-1532-4af3-a5a8-5bc57e192d54]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a1c14-a94c-40b2-9c12-b01dcb5c88b2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJkyXbZx {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uJkyXbZx" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf9821-685c-47d8-9211-904144b0d978]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uJkyXbZx'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fed32a9-28f4-4c73-ab82-11076be023ee]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c332d5-a873-4c07-bbc5-2d57c1c3ad65]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:43:34 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:43:34 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:43:34 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:43:34 user nova-compute[73121]: 
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c75fa51-b8ef-465d-a063-9737b30fa72a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444, portal: 172.16.0.220,3260]
Aug 15 02:43:34 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444, portal: 172.16.0.220,3260] successful.
Aug 15 02:43:34 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9781fe71-dd47-4ec6-a8dd-9b53c78b2d1c]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0671f807-e73e-4620-ba48-c33497a94f56]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 (non-flash)
Aug 15 02:43:34 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 (non-flash)
Aug 15 02:43:34 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a00fe16-8059-494e-b64c-334867c78647]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:34 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJkyXbZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26535313438626232', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535313438626232', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG nova.objects.instance [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'flavor' on Instance uuid 63ff047d-d0e2-449d-a333-272e1d6f0e77 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:43:35 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:43:35 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:43:35 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:43:35 user nova-compute[73121]:   <serial>43874607-8a87-471a-b96f-c7f58b2dc444</serial>
Aug 15 02:43:35 user nova-compute[73121]: </disk>
Aug 15 02:43:35 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] No VIF found with MAC fa:16:3e:56:0f:25, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:43:35 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-7d36a64a-76e6-418d-970a-b6a7080393dd tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.667s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:43:36 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:43:37 user nova-compute[73121]: INFO nova.compute.manager [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Detaching volume 43874607-8a87-471a-b96f-c7f58b2dc444
Aug 15 02:43:37 user nova-compute[73121]: INFO nova.virt.block_device [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Attempting to driver detach volume 43874607-8a87-471a-b96f-c7f58b2dc444 from mountpoint /dev/vdb
Aug 15 02:43:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Attempting to detach device vdb from instance 63ff047d-d0e2-449d-a333-272e1d6f0e77 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:43:37 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:43:37 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:43:37 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:43:37 user nova-compute[73121]:   <serial>43874607-8a87-471a-b96f-c7f58b2dc444</serial>
Aug 15 02:43:37 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:43:37 user nova-compute[73121]: </disk>
Aug 15 02:43:37 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:43:37 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Successfully detached device vdb from instance 63ff047d-d0e2-449d-a333-272e1d6f0e77 from the persistent domain config.
Aug 15 02:43:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 63ff047d-d0e2-449d-a333-272e1d6f0e77 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:43:37 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:43:37 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:43:37 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:43:37 user nova-compute[73121]:   <serial>43874607-8a87-471a-b96f-c7f58b2dc444</serial>
Aug 15 02:43:37 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:43:37 user nova-compute[73121]: </disk>
Aug 15 02:43:37 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692067417.5249083, 63ff047d-d0e2-449d-a333-272e1d6f0e77 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 63ff047d-d0e2-449d-a333-272e1d6f0e77 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:43:37 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Successfully detached device vdb from instance 63ff047d-d0e2-449d-a333-272e1d6f0e77 from the live domain config.
Aug 15 02:43:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uJkyXbZx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:43:37 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[236b0591-c821-4832-8b62-29e08a91e3d1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a1a376-257c-4eed-ab4d-941c44d9b4a9]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 (non-flash)
Aug 15 02:43:37 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 (non-flash)
Aug 15 02:43:37 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e2079be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[741c1fce-b422-4119-bfde-ea8f2c6da544]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f73750-e490-4b43-9977-c8a05f2fe2a6]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd1e3ba-c3fb-4bfb-8638-1f9d46db5141]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b42d98-0da4-461b-8a27-b108d4a1029f]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6222aaed-217b-499d-a84a-ecc357d978cc]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[67abb366-51b7-4fbb-b57b-7f1ffb074310]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444, portal: 172.16.0.220,3260]
Aug 15 02:43:37 user nova-compute[73121]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444, portal: 172.16.0.220,3260] successful.
Aug 15 02:43:37 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43874607-8a87-471a-b96f-c7f58b2dc444 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3247b48-6426-4d26-b493-d3d248ecc937]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] <== disconnect_volume: return (284ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:43:37 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:43:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:38 user nova-compute[73121]: DEBUG nova.objects.instance [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'flavor' on Instance uuid 63ff047d-d0e2-449d-a333-272e1d6f0e77 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:43:38 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-edadad71-e938-47e3-b873-9d00d9561218 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:43:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:43:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:43:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:43:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:43:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:43:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:48 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:43:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:43:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:43:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:43:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:51 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:43:53 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:43:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:43:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:43:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:43:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:43:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:43:56 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:43:57 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:43:57 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:43:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8655MB free_disk=25.100337982177734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 530cca0d-7669-4ffb-ada0-c63283e6a529 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 63ff047d-d0e2-449d-a333-272e1d6f0e77 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:43:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:43:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:00 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:44:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:44:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:44:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:44:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:44:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:44:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:44:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:44:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:44:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:44:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:44:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:44:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:44:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:44:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:44:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-e7cad370-78cc-4f72-9f06-6492e55ae394 req-6b421b3e-247a-4a12-9ab1-e9ff74a06ccd service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received event network-changed-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG nova.compute.manager [req-e7cad370-78cc-4f72-9f06-6492e55ae394 req-6b421b3e-247a-4a12-9ab1-e9ff74a06ccd service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Refreshing instance network info cache due to event network-changed-788858b0-db81-4a54-9722-4e8a7a9b6933. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e7cad370-78cc-4f72-9f06-6492e55ae394 req-6b421b3e-247a-4a12-9ab1-e9ff74a06ccd service nova] Acquiring lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e7cad370-78cc-4f72-9f06-6492e55ae394 req-6b421b3e-247a-4a12-9ab1-e9ff74a06ccd service nova] Acquired lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG nova.network.neutron [req-e7cad370-78cc-4f72-9f06-6492e55ae394 req-6b421b3e-247a-4a12-9ab1-e9ff74a06ccd service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Refreshing network info cache for port 788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:44:27 user nova-compute[73121]: INFO nova.compute.manager [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Terminating instance
Aug 15 02:44:27 user nova-compute[73121]: DEBUG nova.compute.manager [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:27 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG nova.network.neutron [req-e7cad370-78cc-4f72-9f06-6492e55ae394 req-6b421b3e-247a-4a12-9ab1-e9ff74a06ccd service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updated VIF entry in instance network info cache for port 788858b0-db81-4a54-9722-4e8a7a9b6933. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG nova.network.neutron [req-e7cad370-78cc-4f72-9f06-6492e55ae394 req-6b421b3e-247a-4a12-9ab1-e9ff74a06ccd service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updating instance_info_cache with network_info: [{"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-e7cad370-78cc-4f72-9f06-6492e55ae394 req-6b421b3e-247a-4a12-9ab1-e9ff74a06ccd service nova] Releasing lock "refresh_cache-63ff047d-d0e2-449d-a333-272e1d6f0e77" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:44:28 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Instance destroyed successfully.
Aug 15 02:44:28 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'resources' on Instance uuid 63ff047d-d0e2-449d-a333-272e1d6f0e77 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:41:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1413747920',display_name='tempest-TestStampPattern-server-1413747920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1413747920',id=52,image_ref='23d6c39a-9a0d-4cea-bc1c-e74535cd90d0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkYM7k2d5IuMu0HFImfPQ1+dqB9Da59A2YzjIYpVpaa7Vbn2GVoYI2pfv1m0t8UlfXdzXKstBGWaE6ZMlQA6cAvqHCoWMkay5mjXQ+5tZySW3MLxrhOuk6524ND3ubquA==',key_name='tempest-TestStampPattern-1702586286',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:41:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83265e420b174e6796695180a3924727',ramdisk_id='',reservation_id='r-71qsojk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='530cca0d-7669-4ffb-ada0-c63283e6a529',image_min_disk='1',image_min_ram='0',image_owner_id='83265e420b174e6796695180a3924727',image_owner_project_name='tempest-TestStampPattern-1035776336',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1035776336-project-member',image_user_id='bd01d2e58f2040999ecf659c65758d51',owner_project_name='tempest-TestStampPattern-1035776336',owner_user_name='tempest-TestStampPattern-1035776336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:41:39Z,user_data=None,user_id='bd01d2e58f2040999ecf659c65758d51',uuid=63ff047d-d0e2-449d-a333-272e1d6f0e77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converting VIF {"id": "788858b0-db81-4a54-9722-4e8a7a9b6933", "address": "fa:16:3e:56:0f:25", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap788858b0-db", "ovs_interfaceid": "788858b0-db81-4a54-9722-4e8a7a9b6933", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:0f:25,bridge_name='br-int',has_traffic_filtering=True,id=788858b0-db81-4a54-9722-4e8a7a9b6933,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788858b0-db') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG os_vif [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:0f:25,bridge_name='br-int',has_traffic_filtering=True,id=788858b0-db81-4a54-9722-4e8a7a9b6933,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788858b0-db') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap788858b0-db, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:44:28 user nova-compute[73121]: INFO os_vif [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:0f:25,bridge_name='br-int',has_traffic_filtering=True,id=788858b0-db81-4a54-9722-4e8a7a9b6933,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap788858b0-db')
Aug 15 02:44:28 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Deleting instance files /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77_del
Aug 15 02:44:28 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Deletion of /opt/stack/data/nova/instances/63ff047d-d0e2-449d-a333-272e1d6f0e77_del complete
Aug 15 02:44:28 user nova-compute[73121]: INFO nova.compute.manager [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 15 02:44:28 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:44:28 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:44:29 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Took 0.52 seconds to deallocate network for instance.
Aug 15 02:44:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-d4d41386-4021-4b28-950c-a50a29354a64 req-4cde9926-d15b-4ae5-8002-c2beeab57ff7 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received event network-vif-deleted-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:44:29 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Deleted allocations for instance 63ff047d-d0e2-449d-a333-272e1d6f0e77
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d86d746d-a567-4010-863d-71bee742c25f tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.678s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received event network-vif-unplugged-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] No waiting events found dispatching network-vif-unplugged-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:44:29 user nova-compute[73121]: WARNING nova.compute.manager [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received unexpected event network-vif-unplugged-788858b0-db81-4a54-9722-4e8a7a9b6933 for instance with vm_state deleted and task_state None.
Aug 15 02:44:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received event network-vif-plugged-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] Acquiring lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] Lock "63ff047d-d0e2-449d-a333-272e1d6f0e77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:44:29 user nova-compute[73121]: DEBUG nova.compute.manager [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] No waiting events found dispatching network-vif-plugged-788858b0-db81-4a54-9722-4e8a7a9b6933 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:44:29 user nova-compute[73121]: WARNING nova.compute.manager [req-9ffc8b81-fd7f-4fc5-8153-129d7c922ee8 req-b53cbc0c-1a5c-40d5-bcd2-03fc4e4cb493 service nova] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Received unexpected event network-vif-plugged-788858b0-db81-4a54-9722-4e8a7a9b6933 for instance with vm_state deleted and task_state None.
Aug 15 02:44:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:43 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692067468.6061523, 63ff047d-d0e2-449d-a333-272e1d6f0e77 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:44:43 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] VM Stopped (Lifecycle Event)
Aug 15 02:44:43 user nova-compute[73121]: DEBUG nova.compute.manager [None req-24efed46-3829-4e40-8653-8118db7564c9 None None] [instance: 63ff047d-d0e2-449d-a333-272e1d6f0e77] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:44:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:44 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:44:44 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:44:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:44:48 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:44:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:44:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:44:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:44:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:44:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:44:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:44:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:44:57 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:44:57 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:44:57 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=25.10101318359375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:44:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:44:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance 530cca0d-7669-4ffb-ada0-c63283e6a529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:44:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:44:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:44:58 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:44:58 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:44:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:44:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:44:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:45:00 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:14 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:45:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-25eca537-78e5-400a-bade-880e9b8b219b req-36a2e7f1-29b0-4e10-83db-17240dd19d9f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received event network-changed-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG nova.compute.manager [req-25eca537-78e5-400a-bade-880e9b8b219b req-36a2e7f1-29b0-4e10-83db-17240dd19d9f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Refreshing instance network info cache due to event network-changed-694c5b95-ee73-4d6c-8607-9d204cbfadd0. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-25eca537-78e5-400a-bade-880e9b8b219b req-36a2e7f1-29b0-4e10-83db-17240dd19d9f service nova] Acquiring lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-25eca537-78e5-400a-bade-880e9b8b219b req-36a2e7f1-29b0-4e10-83db-17240dd19d9f service nova] Acquired lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG nova.network.neutron [req-25eca537-78e5-400a-bade-880e9b8b219b req-36a2e7f1-29b0-4e10-83db-17240dd19d9f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Refreshing network info cache for port 694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:45:30 user nova-compute[73121]: INFO nova.compute.manager [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Terminating instance
Aug 15 02:45:30 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.network.neutron [req-25eca537-78e5-400a-bade-880e9b8b219b req-36a2e7f1-29b0-4e10-83db-17240dd19d9f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updated VIF entry in instance network info cache for port 694c5b95-ee73-4d6c-8607-9d204cbfadd0. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.network.neutron [req-25eca537-78e5-400a-bade-880e9b8b219b req-36a2e7f1-29b0-4e10-83db-17240dd19d9f service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [{"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:45:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Instance destroyed successfully.
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lazy-loading 'resources' on Instance uuid 530cca0d-7669-4ffb-ada0-c63283e6a529 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-25eca537-78e5-400a-bade-880e9b8b219b req-36a2e7f1-29b0-4e10-83db-17240dd19d9f service nova] Releasing lock "refresh_cache-530cca0d-7669-4ffb-ada0-c63283e6a529" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:38:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-932784771',display_name='tempest-TestStampPattern-server-932784771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-932784771',id=51,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkYM7k2d5IuMu0HFImfPQ1+dqB9Da59A2YzjIYpVpaa7Vbn2GVoYI2pfv1m0t8UlfXdzXKstBGWaE6ZMlQA6cAvqHCoWMkay5mjXQ+5tZySW3MLxrhOuk6524ND3ubquA==',key_name='tempest-TestStampPattern-1702586286',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:38:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83265e420b174e6796695180a3924727',ramdisk_id='',reservation_id='r-ur9g0xd9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1035776336',owner_user_name='tempest-TestStampPattern-1035776336-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:41:30Z,user_data=None,user_id='bd01d2e58f2040999ecf659c65758d51',uuid=530cca0d-7669-4ffb-ada0-c63283e6a529,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converting VIF {"id": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "address": "fa:16:3e:4e:5a:88", "network": {"id": "3182d63e-e60f-4338-ab8b-fa7c3765b31c", "bridge": "br-int", "label": "tempest-TestStampPattern-1779024529-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83265e420b174e6796695180a3924727", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap694c5b95-ee", "ovs_interfaceid": "694c5b95-ee73-4d6c-8607-9d204cbfadd0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:5a:88,bridge_name='br-int',has_traffic_filtering=True,id=694c5b95-ee73-4d6c-8607-9d204cbfadd0,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694c5b95-ee') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG os_vif [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:5a:88,bridge_name='br-int',has_traffic_filtering=True,id=694c5b95-ee73-4d6c-8607-9d204cbfadd0,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694c5b95-ee') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap694c5b95-ee, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:45:31 user nova-compute[73121]: INFO os_vif [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:5a:88,bridge_name='br-int',has_traffic_filtering=True,id=694c5b95-ee73-4d6c-8607-9d204cbfadd0,network=Network(3182d63e-e60f-4338-ab8b-fa7c3765b31c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap694c5b95-ee')
Aug 15 02:45:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Deleting instance files /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529_del
Aug 15 02:45:31 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Deletion of /opt/stack/data/nova/instances/530cca0d-7669-4ffb-ada0-c63283e6a529_del complete
Aug 15 02:45:31 user nova-compute[73121]: INFO nova.compute.manager [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 15 02:45:31 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:45:31 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Took 0.50 seconds to deallocate network for instance.
Aug 15 02:45:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:45:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.104s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:45:31 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Deleted allocations for instance 530cca0d-7669-4ffb-ada0-c63283e6a529
Aug 15 02:45:31 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ffcb4326-0178-4e08-a9cb-b81b280a0311 tempest-TestStampPattern-1035776336 tempest-TestStampPattern-1035776336-project-member] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.680s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:45:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received event network-vif-unplugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:45:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:45:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:45:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:45:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] No waiting events found dispatching network-vif-unplugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:45:32 user nova-compute[73121]: WARNING nova.compute.manager [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received unexpected event network-vif-unplugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 for instance with vm_state deleted and task_state None.
Aug 15 02:45:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received event network-vif-plugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:45:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] Acquiring lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:45:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:45:32 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] Lock "530cca0d-7669-4ffb-ada0-c63283e6a529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:45:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] No waiting events found dispatching network-vif-plugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:45:32 user nova-compute[73121]: WARNING nova.compute.manager [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received unexpected event network-vif-plugged-694c5b95-ee73-4d6c-8607-9d204cbfadd0 for instance with vm_state deleted and task_state None.
Aug 15 02:45:32 user nova-compute[73121]: DEBUG nova.compute.manager [req-ac6d96dd-4058-4628-8c0a-40130bf050ad req-f69b4fba-f514-4b61-8a8b-649a437bb6c7 service nova] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Received event network-vif-deleted-694c5b95-ee73-4d6c-8607-9d204cbfadd0 {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:45:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:46 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692067531.0214114, 530cca0d-7669-4ffb-ada0-c63283e6a529 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:45:46 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] VM Stopped (Lifecycle Event)
Aug 15 02:45:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-916b7025-229c-4b82-baa8-44b77d52f908 None None] [instance: 530cca0d-7669-4ffb-ada0-c63283e6a529] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:45:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:45:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:45:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:45:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:45:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:45:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:45:48 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:50 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:53 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:45:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:45:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 02:45:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:45:58 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:45:58 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:45:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8897MB free_disk=25.225605010986328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:45:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:46:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:46:01 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:46:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:46:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:26 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:31 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:36 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:41 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:46:46 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:46:46 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:46:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:46:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:46:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:46:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:46:46 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:46:49 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:46:51 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:46:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:46:54 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:46:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:46:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:46:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:46:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:46:56 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:46:56 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 02:46:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:46:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:46:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:46:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:46:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:46:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:46:58 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:46:58 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:46:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8598MB free_disk=25.214519500732422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:46:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:46:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:46:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:46:58 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:46:59 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:46:59 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:46:59 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:46:59 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:46:59 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:46:59 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:46:59 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:46:59 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:46:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.536s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:01 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:04 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:06 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:47:08 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:47:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:11 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:12 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:15 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:16 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Starting instance... {{(pid=73121) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73121) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 02:47:17 user nova-compute[73121]: INFO nova.compute.claims [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Claim successful on node user
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Start building networks asynchronously for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Allocating IP information in the background. {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.network.neutron [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] allocate_for_instance() {{(pid=73121) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 02:47:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Start building block device mappings for instance. {{(pid=73121) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Start spawning the instance on the hypervisor. {{(pid=73121) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Creating instance directory {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 02:47:17 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Creating image(s)
Aug 15 02:47:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "/opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "/opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "/opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:47:17 user nova-compute[73121]: DEBUG nova.policy [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a3ccfc5a5a24f1bb4ac41b33aed18af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3d717785ffe4da4856dacd663660536', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73121) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.176s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "59ad79752be594ac21578a5f016dcc5267c7944a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.226s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk 1073741824 {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a,backing_fmt=raw /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk 1073741824" returned: 0 in 0.063s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "59ad79752be594ac21578a5f016dcc5267c7944a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/59ad79752be594ac21578a5f016dcc5267c7944a --force-share --output=json" returned: 0 in 0.198s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk. size=1073741824 {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG nova.network.neutron [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Successfully created port: b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG nova.virt.disk.api [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Cannot resize image /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk to a smaller size. {{(pid=73121) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG nova.objects.instance [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'migration_context' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Created local disks {{(pid=73121) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Ensure instance console log exists: /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/console.log {{(pid=73121) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:47:18 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Successfully updated port: b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Building network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG nova.compute.manager [req-1705e797-1ab1-4fbd-b697-34075256a579 req-7783ac54-a7e4-4ff4-83e5-144ddfe38854 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received event network-changed-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG nova.compute.manager [req-1705e797-1ab1-4fbd-b697-34075256a579 req-7783ac54-a7e4-4ff4-83e5-144ddfe38854 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Refreshing instance network info cache due to event network-changed-b18c35f7-5fb6-4605-94db-40d226bacccf. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1705e797-1ab1-4fbd-b697-34075256a579 req-7783ac54-a7e4-4ff4-83e5-144ddfe38854 service nova] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Instance cache missing network info. {{(pid=73121) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG nova.network.neutron [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Instance network_info: |[{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73121) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1705e797-1ab1-4fbd-b697-34075256a579 req-7783ac54-a7e4-4ff4-83e5-144ddfe38854 service nova] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG nova.network.neutron [req-1705e797-1ab1-4fbd-b697-34075256a579 req-7783ac54-a7e4-4ff4-83e5-144ddfe38854 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Refreshing network info cache for port b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:47:19 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Start _get_guest_xml network_info=[{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'device_name': '/dev/vda', 'encryption_options': None, 'boot_index': 0, 'size': 0, 'disk_bus': 'virtio', 'encrypted': False, 'device_type': 'disk', 'encryption_secret_uuid': None, 'guest_format': None, 'image_id': 'a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 02:47:20 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:47:20 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] CPU controller missing on host. {{(pid=73121) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.host [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] CPU controller found on host. {{(pid=73121) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73121) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T01:56:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T01:56:36Z,direct_url=<?>,disk_format='qcow2',id=a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='455f60549c844284a91966dda1377637',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T01:56:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Flavor limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Image limits 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Flavor pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Image pref 0:0:0 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73121) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Got 1 possible topologies {{(pid=73121) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.hardware [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73121) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-244154225',display_name='tempest-SnapshotDataIntegrityTests-server-244154225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-244154225',id=53,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAelDMbrupHir6eeqxqJz5+YYyFrUjLaBEuuZDGKGSb7KA+vskJCWvKTbOObx410+TcAO74aYcbRYGsN+FP4k/ktEHdltoqAs8c4u87JTgwfltU8X2UzZ0bJN6+TCm8BOg==',key_name='tempest-keypair-58956257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3d717785ffe4da4856dacd663660536',ramdisk_id='',reservation_id='r-tr3f7dlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-307586506',owner_user_name='tempest-SnapshotDataIntegrityTests-307586506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:47:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a3ccfc5a5a24f1bb4ac41b33aed18af',uuid=de8f12e7-26c5-4a46-8f43-c4a16a70d287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73121) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Converting VIF {"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:23:1e,bridge_name='br-int',has_traffic_filtering=True,id=b18c35f7-5fb6-4605-94db-40d226bacccf,network=Network(2b982737-da29-41cc-8d8c-947be722f9fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18c35f7-5f') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.objects.instance [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'pci_devices' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] End _get_guest_xml xml=<domain type="kvm">
Aug 15 02:47:20 user nova-compute[73121]:   <uuid>de8f12e7-26c5-4a46-8f43-c4a16a70d287</uuid>
Aug 15 02:47:20 user nova-compute[73121]:   <name>instance-00000035</name>
Aug 15 02:47:20 user nova-compute[73121]:   <memory>524288</memory>
Aug 15 02:47:20 user nova-compute[73121]:   <vcpu>1</vcpu>
Aug 15 02:47:20 user nova-compute[73121]:   <metadata>
Aug 15 02:47:20 user nova-compute[73121]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 02:47:20 user nova-compute[73121]:       <nova:package version="0.0.0"/>
Aug 15 02:47:20 user nova-compute[73121]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-244154225</nova:name>
Aug 15 02:47:20 user nova-compute[73121]:       <nova:creationTime>2023-08-15 02:47:20</nova:creationTime>
Aug 15 02:47:20 user nova-compute[73121]:       <nova:flavor name="m1.tiny">
Aug 15 02:47:20 user nova-compute[73121]:         <nova:memory>512</nova:memory>
Aug 15 02:47:20 user nova-compute[73121]:         <nova:disk>1</nova:disk>
Aug 15 02:47:20 user nova-compute[73121]:         <nova:swap>0</nova:swap>
Aug 15 02:47:20 user nova-compute[73121]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 02:47:20 user nova-compute[73121]:         <nova:vcpus>1</nova:vcpus>
Aug 15 02:47:20 user nova-compute[73121]:       </nova:flavor>
Aug 15 02:47:20 user nova-compute[73121]:       <nova:owner>
Aug 15 02:47:20 user nova-compute[73121]:         <nova:user uuid="9a3ccfc5a5a24f1bb4ac41b33aed18af">tempest-SnapshotDataIntegrityTests-307586506-project-member</nova:user>
Aug 15 02:47:20 user nova-compute[73121]:         <nova:project uuid="e3d717785ffe4da4856dacd663660536">tempest-SnapshotDataIntegrityTests-307586506</nova:project>
Aug 15 02:47:20 user nova-compute[73121]:       </nova:owner>
Aug 15 02:47:20 user nova-compute[73121]:       <nova:root type="image" uuid="a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb"/>
Aug 15 02:47:20 user nova-compute[73121]:       <nova:ports>
Aug 15 02:47:20 user nova-compute[73121]:         <nova:port uuid="b18c35f7-5fb6-4605-94db-40d226bacccf">
Aug 15 02:47:20 user nova-compute[73121]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 02:47:20 user nova-compute[73121]:         </nova:port>
Aug 15 02:47:20 user nova-compute[73121]:       </nova:ports>
Aug 15 02:47:20 user nova-compute[73121]:     </nova:instance>
Aug 15 02:47:20 user nova-compute[73121]:   </metadata>
Aug 15 02:47:20 user nova-compute[73121]:   <sysinfo type="smbios">
Aug 15 02:47:20 user nova-compute[73121]:     <system>
Aug 15 02:47:20 user nova-compute[73121]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 02:47:20 user nova-compute[73121]:       <entry name="product">OpenStack Nova</entry>
Aug 15 02:47:20 user nova-compute[73121]:       <entry name="version">0.0.0</entry>
Aug 15 02:47:20 user nova-compute[73121]:       <entry name="serial">de8f12e7-26c5-4a46-8f43-c4a16a70d287</entry>
Aug 15 02:47:20 user nova-compute[73121]:       <entry name="uuid">de8f12e7-26c5-4a46-8f43-c4a16a70d287</entry>
Aug 15 02:47:20 user nova-compute[73121]:       <entry name="family">Virtual Machine</entry>
Aug 15 02:47:20 user nova-compute[73121]:     </system>
Aug 15 02:47:20 user nova-compute[73121]:   </sysinfo>
Aug 15 02:47:20 user nova-compute[73121]:   <os>
Aug 15 02:47:20 user nova-compute[73121]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 02:47:20 user nova-compute[73121]:     <boot dev="hd"/>
Aug 15 02:47:20 user nova-compute[73121]:     <smbios mode="sysinfo"/>
Aug 15 02:47:20 user nova-compute[73121]:   </os>
Aug 15 02:47:20 user nova-compute[73121]:   <features>
Aug 15 02:47:20 user nova-compute[73121]:     <acpi/>
Aug 15 02:47:20 user nova-compute[73121]:     <apic/>
Aug 15 02:47:20 user nova-compute[73121]:     <vmcoreinfo/>
Aug 15 02:47:20 user nova-compute[73121]:   </features>
Aug 15 02:47:20 user nova-compute[73121]:   <clock offset="utc">
Aug 15 02:47:20 user nova-compute[73121]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 02:47:20 user nova-compute[73121]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 02:47:20 user nova-compute[73121]:     <timer name="hpet" present="no"/>
Aug 15 02:47:20 user nova-compute[73121]:   </clock>
Aug 15 02:47:20 user nova-compute[73121]:   <cpu mode="custom" match="exact">
Aug 15 02:47:20 user nova-compute[73121]:     <model>Nehalem</model>
Aug 15 02:47:20 user nova-compute[73121]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 02:47:20 user nova-compute[73121]:   </cpu>
Aug 15 02:47:20 user nova-compute[73121]:   <devices>
Aug 15 02:47:20 user nova-compute[73121]:     <disk type="file" device="disk">
Aug 15 02:47:20 user nova-compute[73121]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 02:47:20 user nova-compute[73121]:       <source file="/opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk"/>
Aug 15 02:47:20 user nova-compute[73121]:       <target dev="vda" bus="virtio"/>
Aug 15 02:47:20 user nova-compute[73121]:     </disk>
Aug 15 02:47:20 user nova-compute[73121]:     <interface type="ethernet">
Aug 15 02:47:20 user nova-compute[73121]:       <mac address="fa:16:3e:b3:23:1e"/>
Aug 15 02:47:20 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:47:20 user nova-compute[73121]:       <mtu size="1442"/>
Aug 15 02:47:20 user nova-compute[73121]:       <target dev="tapb18c35f7-5f"/>
Aug 15 02:47:20 user nova-compute[73121]:     </interface>
Aug 15 02:47:20 user nova-compute[73121]:     <serial type="pty">
Aug 15 02:47:20 user nova-compute[73121]:       <log file="/opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/console.log" append="off"/>
Aug 15 02:47:20 user nova-compute[73121]:     </serial>
Aug 15 02:47:20 user nova-compute[73121]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 02:47:20 user nova-compute[73121]:     <video>
Aug 15 02:47:20 user nova-compute[73121]:       <model type="virtio"/>
Aug 15 02:47:20 user nova-compute[73121]:     </video>
Aug 15 02:47:20 user nova-compute[73121]:     <rng model="virtio">
Aug 15 02:47:20 user nova-compute[73121]:       <backend model="random">/dev/urandom</backend>
Aug 15 02:47:20 user nova-compute[73121]:     </rng>
Aug 15 02:47:20 user nova-compute[73121]:     <controller type="usb" index="0" model="none"/>
Aug 15 02:47:20 user nova-compute[73121]:     <memballoon model="virtio">
Aug 15 02:47:20 user nova-compute[73121]:       <stats period="10"/>
Aug 15 02:47:20 user nova-compute[73121]:     </memballoon>
Aug 15 02:47:20 user nova-compute[73121]:   </devices>
Aug 15 02:47:20 user nova-compute[73121]: </domain>
Aug 15 02:47:20 user nova-compute[73121]:  {{(pid=73121) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-244154225',display_name='tempest-SnapshotDataIntegrityTests-server-244154225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-244154225',id=53,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAelDMbrupHir6eeqxqJz5+YYyFrUjLaBEuuZDGKGSb7KA+vskJCWvKTbOObx410+TcAO74aYcbRYGsN+FP4k/ktEHdltoqAs8c4u87JTgwfltU8X2UzZ0bJN6+TCm8BOg==',key_name='tempest-keypair-58956257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3d717785ffe4da4856dacd663660536',ramdisk_id='',reservation_id='r-tr3f7dlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-307586506',owner_user_name='tempest-SnapshotDataIntegrityTests-307586506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T02:47:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a3ccfc5a5a24f1bb4ac41b33aed18af',uuid=de8f12e7-26c5-4a46-8f43-c4a16a70d287,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Converting VIF {"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:23:1e,bridge_name='br-int',has_traffic_filtering=True,id=b18c35f7-5fb6-4605-94db-40d226bacccf,network=Network(2b982737-da29-41cc-8d8c-947be722f9fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18c35f7-5f') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG os_vif [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:23:1e,bridge_name='br-int',has_traffic_filtering=True,id=b18c35f7-5fb6-4605-94db-40d226bacccf,network=Network(2b982737-da29-41cc-8d8c-947be722f9fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18c35f7-5f') {{(pid=73121) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb18c35f7-5f, may_exist=True, interface_attrs={}) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb18c35f7-5f, col_values=(('external_ids', {'iface-id': 'b18c35f7-5fb6-4605-94db-40d226bacccf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:23:1e', 'vm-uuid': 'de8f12e7-26c5-4a46-8f43-c4a16a70d287'}),), if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:20 user nova-compute[73121]: INFO os_vif [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:23:1e,bridge_name='br-int',has_traffic_filtering=True,id=b18c35f7-5fb6-4605-94db-40d226bacccf,network=Network(2b982737-da29-41cc-8d8c-947be722f9fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18c35f7-5f')
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No VIF found with MAC fa:16:3e:b3:23:1e, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.network.neutron [req-1705e797-1ab1-4fbd-b697-34075256a579 req-7783ac54-a7e4-4ff4-83e5-144ddfe38854 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updated VIF entry in instance network info cache for port b18c35f7-5fb6-4605-94db-40d226bacccf. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG nova.network.neutron [req-1705e797-1ab1-4fbd-b697-34075256a579 req-7783ac54-a7e4-4ff4-83e5-144ddfe38854 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:47:20 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-1705e797-1ab1-4fbd-b697-34075256a579 req-7783ac54-a7e4-4ff4-83e5-144ddfe38854 service nova] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:47:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:21 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:21 user nova-compute[73121]: DEBUG nova.compute.manager [req-46c479a6-3b0d-474b-8a86-e8f014f4c7b5 req-3a6e1ffb-dad2-48b4-96f5-09c4e67e8f4f service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received event network-vif-plugged-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:47:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-46c479a6-3b0d-474b-8a86-e8f014f4c7b5 req-3a6e1ffb-dad2-48b4-96f5-09c4e67e8f4f service nova] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:47:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-46c479a6-3b0d-474b-8a86-e8f014f4c7b5 req-3a6e1ffb-dad2-48b4-96f5-09c4e67e8f4f service nova] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:47:21 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-46c479a6-3b0d-474b-8a86-e8f014f4c7b5 req-3a6e1ffb-dad2-48b4-96f5-09c4e67e8f4f service nova] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:21 user nova-compute[73121]: DEBUG nova.compute.manager [req-46c479a6-3b0d-474b-8a86-e8f014f4c7b5 req-3a6e1ffb-dad2-48b4-96f5-09c4e67e8f4f service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] No waiting events found dispatching network-vif-plugged-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:47:21 user nova-compute[73121]: WARNING nova.compute.manager [req-46c479a6-3b0d-474b-8a86-e8f014f4c7b5 req-3a6e1ffb-dad2-48b4-96f5-09c4e67e8f4f service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received unexpected event network-vif-plugged-b18c35f7-5fb6-4605-94db-40d226bacccf for instance with vm_state building and task_state spawning.
Aug 15 02:47:22 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:22 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:47:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:22 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:23 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-63697e09-a8b6-4a43-9f51-88dfee711c34 req-d59cd19a-d371-4e49-8813-beac74f62c4a service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received event network-vif-plugged-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:47:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63697e09-a8b6-4a43-9f51-88dfee711c34 req-d59cd19a-d371-4e49-8813-beac74f62c4a service nova] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:47:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63697e09-a8b6-4a43-9f51-88dfee711c34 req-d59cd19a-d371-4e49-8813-beac74f62c4a service nova] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:47:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-63697e09-a8b6-4a43-9f51-88dfee711c34 req-d59cd19a-d371-4e49-8813-beac74f62c4a service nova] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:23 user nova-compute[73121]: DEBUG nova.compute.manager [req-63697e09-a8b6-4a43-9f51-88dfee711c34 req-d59cd19a-d371-4e49-8813-beac74f62c4a service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] No waiting events found dispatching network-vif-plugged-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:47:23 user nova-compute[73121]: WARNING nova.compute.manager [req-63697e09-a8b6-4a43-9f51-88dfee711c34 req-d59cd19a-d371-4e49-8813-beac74f62c4a service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received unexpected event network-vif-plugged-b18c35f7-5fb6-4605-94db-40d226bacccf for instance with vm_state building and task_state spawning.
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692067644.1249113, de8f12e7-26c5-4a46-8f43-c4a16a70d287 => Resumed> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:47:24 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] VM Resumed (Lifecycle Event)
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Instance event wait completed in 0 seconds for  {{(pid=73121) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Guest created on hypervisor {{(pid=73121) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 02:47:24 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Instance spawned successfully.
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Found default for hw_cdrom_bus of ide {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Found default for hw_disk_bus of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Found default for hw_input_bus of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Found default for hw_pointer_model of None {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Found default for hw_video_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Found default for hw_vif_model of virtio {{(pid=73121) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 02:47:24 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.virt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Emitting event <LifecycleEvent: 1692067644.127412, de8f12e7-26c5-4a46-8f43-c4a16a70d287 => Started> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:47:24 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] VM Started (Lifecycle Event)
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73121) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 02:47:24 user nova-compute[73121]: INFO nova.compute.manager [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 02:47:24 user nova-compute[73121]: INFO nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 15 02:47:24 user nova-compute[73121]: DEBUG nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:47:24 user nova-compute[73121]: INFO nova.compute.manager [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Took 6.97 seconds to build instance.
Aug 15 02:47:24 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-18bc2ac3-b7f8-4ce7-840e-65ffd2d3c197 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.071s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:45 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_power_states {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:45 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Triggering sync for uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 02:47:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:47:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:47:45 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:48 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:47:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:51 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:52 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:47:58 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:47:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:47:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:47:58 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:47:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:47:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:47:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:48:00 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:48:00 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:48:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8489MB free_disk=25.18018341064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:48:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:48:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:06 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:48:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:48:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:48:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:48:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:48:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:48:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:48:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:48:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:48 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:48:48 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:48:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:48:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:48:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:48:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:48:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:48:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:48:57 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:48:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:00 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:49:00 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:49:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8698MB free_disk=25.16986083984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:49:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:49:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:07 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:49:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-520b688b-6bb1-4507-a6b4-b1507d40f61f req-d08d1f6b-9650-4690-9d6d-a65718f71259 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received event network-changed-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:49:09 user nova-compute[73121]: DEBUG nova.compute.manager [req-520b688b-6bb1-4507-a6b4-b1507d40f61f req-d08d1f6b-9650-4690-9d6d-a65718f71259 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Refreshing instance network info cache due to event network-changed-b18c35f7-5fb6-4605-94db-40d226bacccf. {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 02:49:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-520b688b-6bb1-4507-a6b4-b1507d40f61f req-d08d1f6b-9650-4690-9d6d-a65718f71259 service nova] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:49:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-520b688b-6bb1-4507-a6b4-b1507d40f61f req-d08d1f6b-9650-4690-9d6d-a65718f71259 service nova] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:49:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-520b688b-6bb1-4507-a6b4-b1507d40f61f req-d08d1f6b-9650-4690-9d6d-a65718f71259 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Refreshing network info cache for port b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 02:49:09 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-520b688b-6bb1-4507-a6b4-b1507d40f61f req-d08d1f6b-9650-4690-9d6d-a65718f71259 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updated VIF entry in instance network info cache for port b18c35f7-5fb6-4605-94db-40d226bacccf. {{(pid=73121) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 02:49:09 user nova-compute[73121]: DEBUG nova.network.neutron [req-520b688b-6bb1-4507-a6b4-b1507d40f61f req-d08d1f6b-9650-4690-9d6d-a65718f71259 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:49:09 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-520b688b-6bb1-4507-a6b4-b1507d40f61f req-d08d1f6b-9650-4690-9d6d-a65718f71259 service nova] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:49:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG nova.objects.instance [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:49:13 user nova-compute[73121]: INFO nova.compute.manager [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attaching volume d61a6d61-2b96-460f-bd30-a261a87681e1 to /dev/vdb
Aug 15 02:49:13 user nova-compute[73121]: DEBUG os_brick.utils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[549e6312-09fe-4c03-af3d-67584e16542c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e42489-18ea-412a-8c49-2b23a209f076]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b2a690-97ee-4920-9506-cae4097689fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8df9059-12c2-4e25-98a9-8d665d75ab0e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:49:13 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:49:13 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8268a2d6-acb8-4d88-b5f7-38ca6db8a18c]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG os_brick.utils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:49:13 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating existing volume attachment record: b6098ce3-57fd-47f1-8e84-063c7ef1cc41 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:49:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:18 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:20 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:49:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDdkhHwn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:49:21 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:49:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:49:21 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:49:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:49:21 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:49:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[237f15b8-2e96-4cab-9ded-5367d969188a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:49:21 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[959bf0bd-e655-42e8-9b53-1f285ae97e24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1] added
Aug 15 02:49:21 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:21 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b80ec64-956f-4f2b-ad63-2d4fb21b25da]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eea39f2-54a4-42e5-9adf-6e1ef86d7d3d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDdkhHwn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eDdkhHwn" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8ad48c-2d6a-4e6b-b1ce-c6d223c8c3eb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eDdkhHwn'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[381e042c-932b-4eef-994e-440d14ae1f70]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1e7086-e29f-4626-817f-1e209e9e4d3a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:49:22 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:49:22 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:49:22 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:49:22 user nova-compute[73121]: 
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d56ebe3-f70d-418c-baca-883e481a74c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1, portal: 172.16.0.220,3260]
Aug 15 02:49:22 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1, portal: 172.16.0.220,3260] successful.
Aug 15 02:49:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[064fb481-f151-4a7f-a93e-6abce9a1aea6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2d5a99-5af3-40be-bc2b-5a0c10aa3934]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 (non-flash)
Aug 15 02:49:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 (non-flash)
Aug 15 02:49:22 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6374eb1-1640-405c-af3d-7cb04ae43c6b]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:22 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDdkhHwn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23164363763383463', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164363763383463', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG nova.objects.instance [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:49:23 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:49:23 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:49:23 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:49:23 user nova-compute[73121]:   <serial>d61a6d61-2b96-460f-bd30-a261a87681e1</serial>
Aug 15 02:49:23 user nova-compute[73121]: </disk>
Aug 15 02:49:23 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No VIF found with MAC fa:16:3e:b3:23:1e, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:49:23 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-99317fd4-8769-42b2-abd4-0aa03c581511 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.108s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:49:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:28 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:33 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:43 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:49 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:49:49 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:49:50 user nova-compute[73121]: INFO nova.compute.manager [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Detaching volume d61a6d61-2b96-460f-bd30-a261a87681e1
Aug 15 02:49:50 user nova-compute[73121]: INFO nova.virt.block_device [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attempting to driver detach volume d61a6d61-2b96-460f-bd30-a261a87681e1 from mountpoint /dev/vdb
Aug 15 02:49:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Attempting to detach device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:49:50 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:49:50 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:49:50 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:49:50 user nova-compute[73121]:   <serial>d61a6d61-2b96-460f-bd30-a261a87681e1</serial>
Aug 15 02:49:50 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:49:50 user nova-compute[73121]: </disk>
Aug 15 02:49:50 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:49:50 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully detached device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the persistent domain config.
Aug 15 02:49:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:49:50 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:49:50 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:49:50 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:49:50 user nova-compute[73121]:   <serial>d61a6d61-2b96-460f-bd30-a261a87681e1</serial>
Aug 15 02:49:50 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:49:50 user nova-compute[73121]: </disk>
Aug 15 02:49:50 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692067790.7312233, de8f12e7-26c5-4a46-8f43-c4a16a70d287 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:49:50 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully detached device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the live domain config.
Aug 15 02:49:50 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eDdkhHwn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:49:50 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[7726a77d-871b-40fa-bd3f-a65be79c3f04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9390883-3e2d-460b-b8ba-bb52dda4c70e]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 (non-flash)
Aug 15 02:49:50 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 (non-flash)
Aug 15 02:49:50 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc68f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79e3a61-9988-4de1-83e1-646c7494b642]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3170ea97-0258-4d97-baf3-2e0f3eda1536]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a0b02f-17ba-4370-8052-4af741ecb4b0]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c368835-ce4a-4e12-9722-fcd16aad5cf4]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7c9075-a7ca-425b-812b-c8119b8013d5]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e02115-829c-4fce-8855-7c3dd59451b6]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1, portal: 172.16.0.220,3260]
Aug 15 02:49:50 user nova-compute[73121]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1, portal: 172.16.0.220,3260] successful.
Aug 15 02:49:50 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:50 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:49:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d61a6d61-2b96-460f-bd30-a261a87681e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:49:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[279a4e28-de26-4522-95c6-61327ebc8f99]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:49:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:49:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:49:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== disconnect_volume: return (261ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:49:51 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:49:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:49:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-c4073a9e-20b5-400f-8243-e5465c0c5a52 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.585s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:49:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:49:54 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:49:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:49:57 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:49:57 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:49:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:50:00 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:50:01 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:50:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:50:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:50:01 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:50:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:01 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:02 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:50:02 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:50:02 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8751MB free_disk=25.162357330322266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:50:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:50:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:50:02 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:50:02 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:50:02 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:50:02 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:50:02 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:50:02 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:50:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:50:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:50:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:50:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG nova.objects.instance [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:50:44 user nova-compute[73121]: INFO nova.compute.manager [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attaching volume 55dbb699-df86-4111-9323-761e3a2e3e89 to /dev/vdb
Aug 15 02:50:44 user nova-compute[73121]: DEBUG os_brick.utils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab9a25b-772b-4d7f-9bb4-4ee009f2b7b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce190fce-317f-4496-b449-3c3c23bd2633]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c113d9fb-307b-4317-927a-aa0c19cccfb1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb96e5ee-aa26-4e8a-8eac-8ee55634ca29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:50:44 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:50:44 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec67bc8-4a56-4dc7-8014-f21f5651b25f]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG os_brick.utils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:50:44 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating existing volume attachment record: 853b605b-5303-4903-a5cd-128323e8aca9 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:50:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:48 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:51 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgRlUqeT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:50:53 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:50:53 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:50:53 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d0b120-a8a5-46a2-9482-a56ac682430f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:50:53 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dd55ec-58af-4691-86af-2d1b7af31473]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89] added
Aug 15 02:50:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44b9ba7-f446-425d-8fd7-fa34f98f47ed]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[339db122-b923-41e3-9ca5-e331c78053df]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgRlUqeT {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OgRlUqeT" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb4ee09-e025-495f-85d0-c3f2c538a28a]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OgRlUqeT'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f132f3ba-d9ea-429b-9574-1e9a4494a1f6]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[accafbbc-73a7-471d-a61b-9fdff547e605]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:50:53 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:50:53 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:50:53 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:50:53 user nova-compute[73121]: 
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2810a1ae-bd17-4bcd-af39-b80fe65a31b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89, portal: 172.16.0.220,3260]
Aug 15 02:50:53 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89, portal: 172.16.0.220,3260] successful.
Aug 15 02:50:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb2abd0-3016-43d2-941b-bbd1cce047a2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc785675-788b-4a9e-a529-ffee7e82b0e4]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 (non-flash)
Aug 15 02:50:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 (non-flash)
Aug 15 02:50:53 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b59cede-ffde-44e7-9b2d-509840892cd6]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:50:53 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgRlUqeT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:50:54 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:50:54 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23630396136363030', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:50:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630396136363030', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:50:54 user nova-compute[73121]: DEBUG nova.objects.instance [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:50:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:50:54 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:50:54 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:50:54 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:50:54 user nova-compute[73121]:   <serial>55dbb699-df86-4111-9323-761e3a2e3e89</serial>
Aug 15 02:50:54 user nova-compute[73121]: </disk>
Aug 15 02:50:54 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:50:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:50:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:50:54 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No VIF found with MAC fa:16:3e:b3:23:1e, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:50:55 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-26acd98f-3b88-4f5f-a301-08ea98762be8 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.343s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:50:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:50:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:50:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:50:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:50:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:50:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:50:56 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:50:56 user nova-compute[73121]: INFO nova.compute.manager [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Detaching volume 55dbb699-df86-4111-9323-761e3a2e3e89
Aug 15 02:50:57 user nova-compute[73121]: INFO nova.virt.block_device [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attempting to driver detach volume 55dbb699-df86-4111-9323-761e3a2e3e89 from mountpoint /dev/vdb
Aug 15 02:50:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Attempting to detach device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:50:57 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:50:57 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:50:57 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:50:57 user nova-compute[73121]:   <serial>55dbb699-df86-4111-9323-761e3a2e3e89</serial>
Aug 15 02:50:57 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:50:57 user nova-compute[73121]: </disk>
Aug 15 02:50:57 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:50:57 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully detached device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the persistent domain config.
Aug 15 02:50:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:50:57 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:50:57 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:50:57 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:50:57 user nova-compute[73121]:   <serial>55dbb699-df86-4111-9323-761e3a2e3e89</serial>
Aug 15 02:50:57 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:50:57 user nova-compute[73121]: </disk>
Aug 15 02:50:57 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692067857.590123, de8f12e7-26c5-4a46-8f43-c4a16a70d287 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:50:57 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully detached device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the live domain config.
Aug 15 02:50:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OgRlUqeT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:50:57 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f2a838-9ffb-4ef4-bebf-cca9a294359b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35b0c2e-8d07-4f8f-8c44-4fad8543e87c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 (non-flash)
Aug 15 02:50:57 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 (non-flash)
Aug 15 02:50:57 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc68d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[346db23b-646a-423b-b3fd-8ae8544f6dfc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0fca73-e6a1-41a0-a6e5-70c47bf13008]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[147f9121-abca-4d35-a851-5f7e1283e77d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b882596c-2a8b-4e64-a425-0e6083fbcaf2]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e4d882-0967-498c-b1f8-a45de6fcf624]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e819df62-7f84-4584-8ec7-149c82af9ccd]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89, portal: 172.16.0.220,3260]
Aug 15 02:50:57 user nova-compute[73121]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89, portal: 172.16.0.220,3260] successful.
Aug 15 02:50:57 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55dbb699-df86-4111-9323-761e3a2e3e89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c6dc43-bed1-4d9b-884e-4719cf967834]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== disconnect_volume: return (261ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:50:57 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:50:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:50:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:50:58 user nova-compute[73121]: DEBUG nova.objects.instance [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:50:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-ff6d14e1-8a43-437b-9308-06c82c8aa4aa tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.644s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:51:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:02 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:03 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:51:03 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:51:03 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8733MB free_disk=25.161327362060547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:51:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:51:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:09 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:51:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:51:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:51:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:51:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:51:51 user nova-compute[73121]: INFO nova.compute.manager [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attaching volume 4b222071-80af-4a8c-bc4c-58619307aaea to /dev/vdb
Aug 15 02:51:51 user nova-compute[73121]: DEBUG os_brick.utils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafbca2f-8982-46fb-a418-a5640efcca11]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa07daaf-0b2f-4079-88d8-780a89fa22f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9c62e3-12bf-468d-9bd1-6863fc3d1e3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cbd420-a84f-45a9-8c35-d37421cd9477]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:51:51 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:51:51 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10d3991-24e5-4677-b342-781fce149c6d]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG os_brick.utils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:51:51 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating existing volume attachment record: 779fd6aa-55e8-47dc-ab76-3fdef7dc9ef7 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:51:53 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:51:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:51:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:51:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWbhVkYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:51:59 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:51:59 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:51:59 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a428c-823d-4e01-a24b-6c3b390053e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:51:59 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[741cdd93-a6c3-43ad-ad64-9ea048733cbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea] added
Aug 15 02:51:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bc6165-6ba9-4bd5-82fe-47d460f6fc56]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ec4d27-fccc-4209-8449-a01bba1dc9b2]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWbhVkYG {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MWbhVkYG" returned: 0 in 0.024s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c4745f-924a-4186-8922-ee095ba2f4cb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MWbhVkYG'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b6a7be-a82a-4201-8c19-f015743a4edb]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6e726d-024d-4633-8264-6cd8672a8cb3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:51:59 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:51:59 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:51:59 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:51:59 user nova-compute[73121]: 
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a12fb0d-bdbb-4021-a16b-aeba23b7256a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea, portal: 172.16.0.220,3260]
Aug 15 02:51:59 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea, portal: 172.16.0.220,3260] successful.
Aug 15 02:51:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[749a080a-b8cc-4bbd-84ab-11c7b3d5306d]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[53adbb76-ce71-46bf-9d9b-467ce58820bf]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea (non-flash)
Aug 15 02:51:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea (non-flash)
Aug 15 02:51:59 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb62556-d9c0-4af6-b95a-7478ecc124eb]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:51:59 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:52:00 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:00 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:52:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWbhVkYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:52:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:52:00 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23933613830633761', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:52:00 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23933613830633761', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:52:01 user nova-compute[73121]: DEBUG nova.objects.instance [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:52:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:52:01 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:52:01 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:52:01 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:52:01 user nova-compute[73121]:   <serial>4b222071-80af-4a8c-bc4c-58619307aaea</serial>
Aug 15 02:52:01 user nova-compute[73121]: </disk>
Aug 15 02:52:01 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:52:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:52:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:52:01 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No VIF found with MAC fa:16:3e:b3:23:1e, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:52:01 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-b52423d2-c5f1-46d4-8b7e-79989024d26c tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.194s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:52:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:52:03 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:52:03 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:52:03 user nova-compute[73121]: INFO nova.compute.manager [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Detaching volume 4b222071-80af-4a8c-bc4c-58619307aaea
Aug 15 02:52:03 user nova-compute[73121]: INFO nova.virt.block_device [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attempting to driver detach volume 4b222071-80af-4a8c-bc4c-58619307aaea from mountpoint /dev/vdb
Aug 15 02:52:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Attempting to detach device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:52:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:52:03 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:52:03 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:52:03 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:52:03 user nova-compute[73121]:   <serial>4b222071-80af-4a8c-bc4c-58619307aaea</serial>
Aug 15 02:52:03 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:52:03 user nova-compute[73121]: </disk>
Aug 15 02:52:03 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:52:03 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully detached device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the persistent domain config.
Aug 15 02:52:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:52:03 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:52:03 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:52:03 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:52:03 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:52:03 user nova-compute[73121]:   <serial>4b222071-80af-4a8c-bc4c-58619307aaea</serial>
Aug 15 02:52:03 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:52:03 user nova-compute[73121]: </disk>
Aug 15 02:52:03 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692067924.2391124, de8f12e7-26c5-4a46-8f43-c4a16a70d287 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:52:04 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully detached device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the live domain config.
Aug 15 02:52:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MWbhVkYG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:52:04 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1604b8de-037f-49ac-ad74-9a59dbff7970]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[40000dd5-412c-468f-a075-04e15ed39511]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea (non-flash)
Aug 15 02:52:04 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea (non-flash)
Aug 15 02:52:04 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1dfc63a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85121cb-4a97-4c15-b05d-c39dce946b12]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[931ee63d-133a-4ab0-8720-bfdd16db6776]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fba0f4-b103-457c-b39b-99db0a01b566]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ef8307-6cfb-439f-8114-c4a422255aca]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[755ca6f7-ff97-4870-ba67-7a70749634de]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[defa8151-12f9-4b76-9fe0-b888837a008d]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea, portal: 172.16.0.220,3260]
Aug 15 02:52:04 user nova-compute[73121]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea, portal: 172.16.0.220,3260] successful.
Aug 15 02:52:04 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b222071-80af-4a8c-bc4c-58619307aaea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d21f2f-0443-4322-942e-776169c0d517]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== disconnect_volume: return (322ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:52:04 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:05 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:52:05 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8742MB free_disk=25.160442352294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.objects.instance [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-2aa141e5-efdf-4b72-b6ad-5998cf8d3628 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing inventories for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating ProviderTree inventory for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Updating inventory in ProviderTree for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing aggregate associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, aggregates: None {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Refreshing trait associations for resource provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf, traits: COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_EXTEND,COMPUTE_NODE,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_VOLUME_MULTI_ATTACH {{(pid=73121) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:52:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.613s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:52:08 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:14 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 02:52:14 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] There are 0 instances to clean {{(pid=73121) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 02:52:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:52:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:21 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:25 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:25 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Cleaning up deleted instances with incomplete migration  {{(pid=73121) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 02:52:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:52 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:52 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:52:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:52:57 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:52:57 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:52:58 user nova-compute[73121]: INFO nova.compute.manager [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attaching volume e66ebfec-2f49-4157-a843-e6390e214579 to /dev/vdb
Aug 15 02:52:58 user nova-compute[73121]: DEBUG os_brick.utils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bf36f6-9b22-490a-8acc-5394f1682322]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:df81dd3ac49e\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdb832f-2b67-4e51-a91a-ac8901a89469]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9841297-c901-493b-962e-b80bf0ae5c5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[23522a99-a7af-41db-a6f0-51aac56bc189]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Running cmd (subprocess): nvme version {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] 'nvme version' failed. Not Retrying. {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] nvme not present on system {{(pid=73121) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 02:52:58 user nova-compute[73121]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 02:52:58 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bdd4ac-3253-4a5d-9e91-8c14c6fcf7e8]: (4, '') {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73121) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.lightos [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] LIGHTOS: no hostnqn found. {{(pid=73121) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG os_brick.utils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:df81dd3ac49e', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG nova.virt.block_device [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating existing volume attachment record: 25b2ac16-e920-45a4-9b46-8b4fc5071a03 {{(pid=73121) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 02:52:58 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:52:59 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:53:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:01 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:53:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:05 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:53:05 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:53:05 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8763MB free_disk=25.159652709960938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:53:05 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.237s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Calling os-brick to attach iSCSI Volume {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYTPpNQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:53:06 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:53:06 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:53:06 user nova-compute[73121]: INFO os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600485b-3172-4728-889c-f28f54641766]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 02:53:06 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --interface default --op new {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5167ae-4769-4e67-9169-9eead704a7c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579] added\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579] added
Aug 15 02:53:06 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdbe123-ebda-4e35-a3fc-76e0e15a6427]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a4ba5e-fd9a-4c6d-a8e7-71d922f5fc06]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYTPpNQb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYTPpNQb" returned: 0 in 0.023s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[a735c4b0-e66f-4541-8f1b-d0fd7a30f912]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DYTPpNQb'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[531974f2-ceeb-4c06-8232-a69b230b201f]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:06 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f18981-9995-49e6-bb2d-4fb81ccd88c7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:53:07 user nova-compute[73121]:  {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 02:53:07 user nova-compute[73121]:  {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:53:07 user nova-compute[73121]: WARNING os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 02:53:07 user nova-compute[73121]: 
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --login {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca3209-b7a0-4a60-a493-532f59bfac9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579, portal: 172.16.0.220,3260]
Aug 15 02:53:07 user nova-compute[73121]: Login to [iface: default, target: iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579, portal: 172.16.0.220,3260] successful.
Aug 15 02:53:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28de895-12fc-44f9-bf28-2094407df9ac]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[126f21b6-68f0-4b0d-80f6-9b6d04966574]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 (non-flash)
Aug 15 02:53:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 (non-flash)
Aug 15 02:53:07 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Connected to 172.16.0.220:3260 {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73121) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73121) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97e6b32-eba3-4310-8724-3c4456abec14]: (4, ('- - 0', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73121) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 02:53:07 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYTPpNQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73121) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 02:53:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:53:08 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26464306664653261', 'path': '/dev/sdb'} {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:53:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464306664653261', 'path': '/dev/sdb'} {{(pid=73121) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 02:53:08 user nova-compute[73121]: DEBUG nova.objects.instance [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:53:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 02:53:08 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:53:08 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:53:08 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:53:08 user nova-compute[73121]:   <serial>e66ebfec-2f49-4157-a843-e6390e214579</serial>
Aug 15 02:53:08 user nova-compute[73121]: </disk>
Aug 15 02:53:08 user nova-compute[73121]:  {{(pid=73121) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 02:53:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No BDM found with device name vda, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:53:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73121) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 02:53:08 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] No VIF found with MAC fa:16:3e:b3:23:1e, not building metadata {{(pid=73121) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 02:53:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-d3c307b1-fa1e-433f-a816-c47b403a3ff1 tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.555s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:53:10 user nova-compute[73121]: INFO nova.compute.manager [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Detaching volume e66ebfec-2f49-4157-a843-e6390e214579
Aug 15 02:53:10 user nova-compute[73121]: INFO nova.virt.block_device [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Attempting to driver detach volume e66ebfec-2f49-4157-a843-e6390e214579 from mountpoint /dev/vdb
Aug 15 02:53:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Attempting to detach device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the persistent domain config. {{(pid=73121) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:53:10 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:53:10 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:53:10 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:53:10 user nova-compute[73121]:   <serial>e66ebfec-2f49-4157-a843-e6390e214579</serial>
Aug 15 02:53:10 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:53:10 user nova-compute[73121]: </disk>
Aug 15 02:53:10 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:53:10 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully detached device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the persistent domain config.
Aug 15 02:53:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the live domain config. {{(pid=73121) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.guest [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 02:53:10 user nova-compute[73121]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 02:53:10 user nova-compute[73121]:   <source dev="/dev/sdb"/>
Aug 15 02:53:10 user nova-compute[73121]:   <target dev="vdb" bus="virtio"/>
Aug 15 02:53:10 user nova-compute[73121]:   <serial>e66ebfec-2f49-4157-a843-e6390e214579</serial>
Aug 15 02:53:10 user nova-compute[73121]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 02:53:10 user nova-compute[73121]: </disk>
Aug 15 02:53:10 user nova-compute[73121]:  {{(pid=73121) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-ed8cc5cc-7842-40c1-ad64-a19e2f1c32a4 None None] Received event <DeviceRemovedEvent: 1692067990.890641, de8f12e7-26c5-4a46-8f43-c4a16a70d287 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73121) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.driver [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 02:53:10 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully detached device vdb from instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 from the live domain config.
Aug 15 02:53:10 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] calling os-brick to detach iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f1e207a1810>, {'target_iqns': ['iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYTPpNQb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 02:53:10 user nova-compute[73121]: WARNING os_brick.initiator.connectors.base [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 02:53:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579', 0)] {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[5136f542-b85f-4325-ba6c-6cdc80b3839d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[b277cf0b-4c5e-43b9-a384-704e09d4ca51]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 (non-flash)\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 (non-flash)
Aug 15 02:53:10 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 (non-flash)
Aug 15 02:53:10 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1e205abf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579'): ({'sdb'}, set())}) {{(pid=73121) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Removing single pathed devices sdb {{(pid=73121) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c9e97c-b3e0-43cf-a8fa-ce39ffe27cac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b2e141-a5be-428e-a357-e5c190d6f2c0]: (4, ('ok\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Flushing IO for device /dev/sdb {{(pid=73121) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 02:53:10 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96af6ce-633a-4d77-9814-a6642bfbc995]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73121) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b77823-286f-4261-8eca-e0bf3bde1455]: (4, ('1', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG os_brick.initiator.linuxscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] SCSI volumes sdb have been removed. {{(pid=73121) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579')] {{(pid=73121) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd605f6-23eb-4a2e-988e-01a474f67513]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --logout {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b16532d-301f-424d-b18b-452a0f411811]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579, portal: 172.16.0.220,3260]
Aug 15 02:53:11 user nova-compute[73121]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579, portal: 172.16.0.220,3260] successful.
Aug 15 02:53:11 user nova-compute[73121]:  stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op delete {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e66ebfec-2f49-4157-a843-e6390e214579 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84043) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d49555-8eb2-4c74-9701-35c276254182]: (4, ('', '')) {{(pid=84043) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73121) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.base [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] <== disconnect_volume: return (270ms) None {{(pid=73121) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Disconnected iSCSI Volume {{(pid=73121) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG nova.objects.instance [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'flavor' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:53:11 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-4f13f8bb-0b50-4947-a78b-991a0f3210cf tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.495s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:53:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:53:13 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:53:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:53:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:53:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:53:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:23 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:53:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:53:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:53:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:53:54 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:53:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:53:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:53:56 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:53:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:53:59 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:54:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:01 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquired lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Forcefully refreshing network info cache for instance {{(pid=73121) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG nova.objects.instance [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lazy-loading 'info_cache' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG nova.network.neutron [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [{"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Releasing lock "refresh_cache-de8f12e7-26c5-4a46-8f43-c4a16a70d287" {{(pid=73121) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 02:54:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updated the network info_cache for instance {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 02:54:03 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:54:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:54:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:54:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:54:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:54:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:06 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:54:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:54:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:54:06 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:54:06 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:54:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:54:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:54:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 02:54:06 user nova-compute[73121]: DEBUG oslo_concurrency.processutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73121) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 02:54:07 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:54:07 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:54:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8746MB free_disk=25.158775329589844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:54:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:54:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:54:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Instance de8f12e7-26c5-4a46-8f43-c4a16a70d287 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73121) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 02:54:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:54:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:54:07 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:54:07 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:54:07 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:54:07 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:54:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:12 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:54:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:54:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:54:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:54:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:54:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:54:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:54:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:54:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:54:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:54:39 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:54:39 user nova-compute[73121]: INFO nova.compute.manager [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Terminating instance
Aug 15 02:54:39 user nova-compute[73121]: DEBUG nova.compute.manager [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Start destroying the instance on the hypervisor. {{(pid=73121) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 02:54:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:39 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-ba1d4ee7-52fd-4471-ac63-21a3457271f3 req-20068618-5552-4f7e-9f89-3ece04cd364d service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received event network-vif-unplugged-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ba1d4ee7-52fd-4471-ac63-21a3457271f3 req-20068618-5552-4f7e-9f89-3ece04cd364d service nova] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ba1d4ee7-52fd-4471-ac63-21a3457271f3 req-20068618-5552-4f7e-9f89-3ece04cd364d service nova] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-ba1d4ee7-52fd-4471-ac63-21a3457271f3 req-20068618-5552-4f7e-9f89-3ece04cd364d service nova] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-ba1d4ee7-52fd-4471-ac63-21a3457271f3 req-20068618-5552-4f7e-9f89-3ece04cd364d service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] No waiting events found dispatching network-vif-unplugged-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG nova.compute.manager [req-ba1d4ee7-52fd-4471-ac63-21a3457271f3 req-20068618-5552-4f7e-9f89-3ece04cd364d service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received event network-vif-unplugged-b18c35f7-5fb6-4605-94db-40d226bacccf for instance with task_state deleting. {{(pid=73121) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [-] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Instance destroyed successfully.
Aug 15 02:54:40 user nova-compute[73121]: DEBUG nova.objects.instance [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lazy-loading 'resources' on Instance uuid de8f12e7-26c5-4a46-8f43-c4a16a70d287 {{(pid=73121) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG nova.virt.libvirt.vif [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T02:47:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-244154225',display_name='tempest-SnapshotDataIntegrityTests-server-244154225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-244154225',id=53,image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAelDMbrupHir6eeqxqJz5+YYyFrUjLaBEuuZDGKGSb7KA+vskJCWvKTbOObx410+TcAO74aYcbRYGsN+FP4k/ktEHdltoqAs8c4u87JTgwfltU8X2UzZ0bJN6+TCm8BOg==',key_name='tempest-keypair-58956257',keypairs=<?>,launch_index=0,launched_at=2023-08-15T02:47:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3d717785ffe4da4856dacd663660536',ramdisk_id='',reservation_id='r-tr3f7dlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a1c42379-0a53-4b2c-9d1c-5d43b3fcd7bb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-307586506',owner_user_name='tempest-SnapshotDataIntegrityTests-307586506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T02:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a3ccfc5a5a24f1bb4ac41b33aed18af',uuid=de8f12e7-26c5-4a46-8f43-c4a16a70d287,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Converting VIF {"id": "b18c35f7-5fb6-4605-94db-40d226bacccf", "address": "fa:16:3e:b3:23:1e", "network": {"id": "2b982737-da29-41cc-8d8c-947be722f9fe", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-197338586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3d717785ffe4da4856dacd663660536", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb18c35f7-5f", "ovs_interfaceid": "b18c35f7-5fb6-4605-94db-40d226bacccf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG nova.network.os_vif_util [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:23:1e,bridge_name='br-int',has_traffic_filtering=True,id=b18c35f7-5fb6-4605-94db-40d226bacccf,network=Network(2b982737-da29-41cc-8d8c-947be722f9fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18c35f7-5f') {{(pid=73121) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG os_vif [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:23:1e,bridge_name='br-int',has_traffic_filtering=True,id=b18c35f7-5fb6-4605-94db-40d226bacccf,network=Network(2b982737-da29-41cc-8d8c-947be722f9fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18c35f7-5f') {{(pid=73121) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb18c35f7-5f, bridge=br-int, if_exists=True) {{(pid=73121) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:54:40 user nova-compute[73121]: INFO os_vif [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:23:1e,bridge_name='br-int',has_traffic_filtering=True,id=b18c35f7-5fb6-4605-94db-40d226bacccf,network=Network(2b982737-da29-41cc-8d8c-947be722f9fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb18c35f7-5f')
Aug 15 02:54:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Deleting instance files /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287_del
Aug 15 02:54:40 user nova-compute[73121]: INFO nova.virt.libvirt.driver [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Deletion of /opt/stack/data/nova/instances/de8f12e7-26c5-4a46-8f43-c4a16a70d287_del complete
Aug 15 02:54:40 user nova-compute[73121]: INFO nova.compute.manager [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 02:54:40 user nova-compute[73121]: DEBUG oslo.service.loopingcall [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73121) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG nova.compute.manager [-] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Deallocating network for instance {{(pid=73121) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 02:54:40 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] deallocate_for_instance() {{(pid=73121) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 02:54:41 user nova-compute[73121]: DEBUG nova.network.neutron [-] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Updating instance_info_cache with network_info: [] {{(pid=73121) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 02:54:41 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Took 0.83 seconds to deallocate network for instance.
Aug 15 02:54:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:54:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:54:41 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:54:41 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:54:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:54:41 user nova-compute[73121]: INFO nova.scheduler.client.report [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Deleted allocations for instance de8f12e7-26c5-4a46-8f43-c4a16a70d287
Aug 15 02:54:41 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-f3189895-3d97-423b-9123-5bac4ca2797d tempest-SnapshotDataIntegrityTests-307586506 tempest-SnapshotDataIntegrityTests-307586506-project-member] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.107s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:54:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-6fc74117-adc9-4c5e-aff5-87de1c8f5186 req-5ee88049-b113-483c-b6e0-f12a5ad18469 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received event network-vif-plugged-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:54:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6fc74117-adc9-4c5e-aff5-87de1c8f5186 req-5ee88049-b113-483c-b6e0-f12a5ad18469 service nova] Acquiring lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:54:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6fc74117-adc9-4c5e-aff5-87de1c8f5186 req-5ee88049-b113-483c-b6e0-f12a5ad18469 service nova] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:54:42 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [req-6fc74117-adc9-4c5e-aff5-87de1c8f5186 req-5ee88049-b113-483c-b6e0-f12a5ad18469 service nova] Lock "de8f12e7-26c5-4a46-8f43-c4a16a70d287-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:54:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-6fc74117-adc9-4c5e-aff5-87de1c8f5186 req-5ee88049-b113-483c-b6e0-f12a5ad18469 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] No waiting events found dispatching network-vif-plugged-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 02:54:42 user nova-compute[73121]: WARNING nova.compute.manager [req-6fc74117-adc9-4c5e-aff5-87de1c8f5186 req-5ee88049-b113-483c-b6e0-f12a5ad18469 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received unexpected event network-vif-plugged-b18c35f7-5fb6-4605-94db-40d226bacccf for instance with vm_state deleted and task_state None.
Aug 15 02:54:42 user nova-compute[73121]: DEBUG nova.compute.manager [req-6fc74117-adc9-4c5e-aff5-87de1c8f5186 req-5ee88049-b113-483c-b6e0-f12a5ad18469 service nova] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Received event network-vif-deleted-b18c35f7-5fb6-4605-94db-40d226bacccf {{(pid=73121) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 02:54:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:54:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:54:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:54:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:54:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:54:54 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:54:54 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:54:55 user nova-compute[73121]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692068080.5970037, de8f12e7-26c5-4a46-8f43-c4a16a70d287 => Stopped> {{(pid=73121) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 02:54:55 user nova-compute[73121]: INFO nova.compute.manager [-] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] VM Stopped (Lifecycle Event)
Aug 15 02:54:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-e2c1f73c-988a-47cc-acb9-e9cf9278bede None None] [instance: de8f12e7-26c5-4a46-8f43-c4a16a70d287] Checking state {{(pid=73121) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 02:54:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:54:57 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:54:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:00 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:01 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:02 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Starting heal instance info cache {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 02:55:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Rebuilding the list of instances to heal {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 02:55:02 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Didn't find any instances for network info cache update. {{(pid=73121) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 02:55:03 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:05 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager.update_available_resource {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Auditing locally available compute resources for user (node: user) {{(pid=73121) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 02:55:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:55:08 user nova-compute[73121]: WARNING nova.virt.libvirt.driver [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 02:55:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Hypervisor/Node resource view: name=user free_ram=8876MB free_disk=25.1849365234375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73121) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73121) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG nova.compute.provider_tree [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed in ProviderTree for provider: f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf {{(pid=73121) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG nova.scheduler.client.report [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Inventory has not changed for provider f345f9b5-2e3b-4e1e-bffe-c2aa26a83aaf based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73121) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG nova.compute.resource_tracker [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Compute_service record updated for user:user {{(pid=73121) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 02:55:08 user nova-compute[73121]: DEBUG oslo_concurrency.lockutils [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=73121) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 02:55:10 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:55:11 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:55:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:55:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:55:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:55:15 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:20 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:55:24 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:25 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:30 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:34 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:35 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:38 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:40 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:45 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:50 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:55:55 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:55 user nova-compute[73121]: DEBUG nova.compute.manager [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73121) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 02:55:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 02:55:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73121) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 02:55:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:55:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73121) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 02:55:55 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 02:55:57 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:55:58 user nova-compute[73121]: DEBUG oslo_service.periodic_task [None req-6c766dcf-17dc-4ec6-80aa-e2285ad801ef None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73121) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 02:56:00 user nova-compute[73121]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=73121) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}